00:00:00.000 Started by upstream project "autotest-per-patch" build number 121260 00:00:00.000 originally caused by: 00:00:00.000 Started by user sys_sgci 00:00:00.091 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.092 The recommended git tool is: git 00:00:00.092 using credential 00000000-0000-0000-0000-000000000002 00:00:00.097 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.145 Fetching changes from the remote Git repository 00:00:00.147 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.187 Using shallow fetch with depth 1 00:00:00.187 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.187 > git --version # timeout=10 00:00:00.218 > git --version # 'git version 2.39.2' 00:00:00.218 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.219 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.219 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.313 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.325 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.337 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:06.337 > git config core.sparsecheckout # timeout=10 00:00:06.348 > git read-tree -mu HEAD # timeout=10 00:00:06.365 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:06.384 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:06.384 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:06.457 [Pipeline] Start of Pipeline 00:00:06.471 [Pipeline] library 00:00:06.473 Loading library shm_lib@master 00:00:06.473 Library shm_lib@master is cached. Copying from home. 00:00:06.491 [Pipeline] node 00:00:06.507 Running on CYP9 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:06.509 [Pipeline] { 00:00:06.519 [Pipeline] catchError 00:00:06.521 [Pipeline] { 00:00:06.534 [Pipeline] wrap 00:00:06.543 [Pipeline] { 00:00:06.549 [Pipeline] stage 00:00:06.550 [Pipeline] { (Prologue) 00:00:06.728 [Pipeline] sh 00:00:07.012 + logger -p user.info -t JENKINS-CI 00:00:07.031 [Pipeline] echo 00:00:07.032 Node: CYP9 00:00:07.039 [Pipeline] sh 00:00:07.342 [Pipeline] setCustomBuildProperty 00:00:07.355 [Pipeline] echo 00:00:07.357 Cleanup processes 00:00:07.361 [Pipeline] sh 00:00:07.652 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.652 3184485 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.666 [Pipeline] sh 00:00:07.956 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.956 ++ grep -v 'sudo pgrep' 00:00:07.956 ++ awk '{print $1}' 00:00:07.956 + sudo kill -9 00:00:07.956 + true 00:00:07.973 [Pipeline] cleanWs 00:00:07.984 [WS-CLEANUP] Deleting project workspace... 00:00:07.984 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.992 [WS-CLEANUP] done 00:00:07.996 [Pipeline] setCustomBuildProperty 00:00:08.007 [Pipeline] sh 00:00:08.289 + sudo git config --global --replace-all safe.directory '*' 00:00:08.367 [Pipeline] nodesByLabel 00:00:08.369 Found a total of 1 nodes with the 'sorcerer' label 00:00:08.381 [Pipeline] httpRequest 00:00:08.387 HttpMethod: GET 00:00:08.387 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.390 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.393 Response Code: HTTP/1.1 200 OK 00:00:08.394 Success: Status code 200 is in the accepted range: 200,404 00:00:08.395 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:09.284 [Pipeline] sh 00:00:09.591 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:09.608 [Pipeline] httpRequest 00:00:09.612 HttpMethod: GET 00:00:09.612 URL: http://10.211.164.96/packages/spdk_52d0b12f93a1b5ef2f3977acb95a8fe6148d8292.tar.gz 00:00:09.613 Sending request to url: http://10.211.164.96/packages/spdk_52d0b12f93a1b5ef2f3977acb95a8fe6148d8292.tar.gz 00:00:09.616 Response Code: HTTP/1.1 200 OK 00:00:09.616 Success: Status code 200 is in the accepted range: 200,404 00:00:09.617 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_52d0b12f93a1b5ef2f3977acb95a8fe6148d8292.tar.gz 00:00:25.501 [Pipeline] sh 00:00:25.789 + tar --no-same-owner -xf spdk_52d0b12f93a1b5ef2f3977acb95a8fe6148d8292.tar.gz 00:00:29.106 [Pipeline] sh 00:00:29.390 + git -C spdk log --oneline -n5 00:00:29.390 52d0b12f9 lib/idxd: use bit array to track WQ use 00:00:29.390 0a9d271eb lib/idxd: refactor IDXD wq config common parts 00:00:29.390 dccfcb485 lib/idxd: alloc and dealloc batches one by one 00:00:29.390 0b98dab99 lib/idxd: deallocate batches on channel creation failure 00:00:29.390 4beaf1ee3 lib/idxd: simplify early failure in _dsa_alloc_batches 00:00:29.404 [Pipeline] } 00:00:29.422 [Pipeline] // stage 00:00:29.432 [Pipeline] stage 00:00:29.435 [Pipeline] { (Prepare) 00:00:29.453 [Pipeline] writeFile 00:00:29.470 [Pipeline] sh 00:00:29.757 + logger -p user.info -t JENKINS-CI 00:00:29.772 [Pipeline] sh 00:00:30.057 + logger -p user.info -t JENKINS-CI 00:00:30.070 [Pipeline] sh 00:00:30.354 + cat autorun-spdk.conf 00:00:30.355 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:30.355 SPDK_TEST_NVMF=1 00:00:30.355 SPDK_TEST_NVME_CLI=1 00:00:30.355 SPDK_TEST_NVMF_NICS=mlx5 00:00:30.355 SPDK_RUN_UBSAN=1 00:00:30.355 NET_TYPE=phy 00:00:30.363 RUN_NIGHTLY=0 00:00:30.367 [Pipeline] readFile 00:00:30.392 [Pipeline] withEnv 00:00:30.394 [Pipeline] { 00:00:30.406 [Pipeline] sh 00:00:30.692 + set -ex 00:00:30.692 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:00:30.692 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:30.692 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:30.692 ++ SPDK_TEST_NVMF=1 00:00:30.692 ++ SPDK_TEST_NVME_CLI=1 00:00:30.692 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:30.692 ++ SPDK_RUN_UBSAN=1 00:00:30.692 ++ NET_TYPE=phy 00:00:30.692 ++ RUN_NIGHTLY=0 00:00:30.692 + case $SPDK_TEST_NVMF_NICS in 00:00:30.692 + DRIVERS=mlx5_ib 00:00:30.692 + [[ -n mlx5_ib ]] 00:00:30.692 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:30.692 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:30.692 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:30.692 rmmod: ERROR: Module irdma is not currently loaded 00:00:30.692 rmmod: ERROR: Module i40iw is not currently loaded 00:00:30.692 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:30.692 + true 00:00:30.692 + for D in $DRIVERS 00:00:30.692 + sudo modprobe mlx5_ib 00:00:30.692 + exit 0 00:00:30.703 [Pipeline] } 00:00:30.719 [Pipeline] // withEnv 00:00:30.724 [Pipeline] } 00:00:30.739 [Pipeline] // stage 00:00:30.750 [Pipeline] catchError 00:00:30.751 [Pipeline] { 00:00:30.768 [Pipeline] timeout 00:00:30.768 Timeout set to expire in 40 min 00:00:30.769 [Pipeline] { 00:00:30.783 [Pipeline] stage 00:00:30.785 [Pipeline] { (Tests) 00:00:30.800 [Pipeline] sh 00:00:31.088 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:00:31.088 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:00:31.088 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:00:31.088 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:00:31.088 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:31.088 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:00:31.088 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:00:31.088 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:31.088 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:00:31.088 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:31.088 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:00:31.088 + source /etc/os-release 00:00:31.088 ++ NAME='Fedora Linux' 00:00:31.088 ++ VERSION='38 (Cloud Edition)' 00:00:31.088 ++ ID=fedora 00:00:31.088 ++ VERSION_ID=38 00:00:31.088 ++ VERSION_CODENAME= 00:00:31.088 ++ PLATFORM_ID=platform:f38 00:00:31.088 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:31.088 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:31.088 ++ LOGO=fedora-logo-icon 00:00:31.088 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:31.088 ++ HOME_URL=https://fedoraproject.org/ 00:00:31.088 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:31.088 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:31.088 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:31.088 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:31.088 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:31.088 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:31.088 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:31.088 ++ SUPPORT_END=2024-05-14 00:00:31.088 ++ VARIANT='Cloud Edition' 00:00:31.088 ++ VARIANT_ID=cloud 00:00:31.088 + uname -a 00:00:31.088 Linux spdk-cyp-09 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:31.088 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:00:34.411 Hugepages 00:00:34.411 node hugesize free / total 00:00:34.411 node0 1048576kB 0 / 0 00:00:34.411 node0 2048kB 0 / 0 00:00:34.411 node1 1048576kB 0 / 0 00:00:34.411 node1 2048kB 0 / 0 00:00:34.411 00:00:34.411 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:34.411 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:00:34.411 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:00:34.411 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:00:34.411 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:00:34.411 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:00:34.412 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:00:34.412 + rm -f /tmp/spdk-ld-path 00:00:34.412 + source autorun-spdk.conf 00:00:34.412 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:34.412 ++ SPDK_TEST_NVMF=1 00:00:34.412 ++ SPDK_TEST_NVME_CLI=1 00:00:34.412 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:34.412 ++ SPDK_RUN_UBSAN=1 00:00:34.412 ++ NET_TYPE=phy 00:00:34.412 ++ RUN_NIGHTLY=0 00:00:34.412 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:34.412 + [[ -n '' ]] 00:00:34.412 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:34.412 + for M in /var/spdk/build-*-manifest.txt 00:00:34.412 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:34.412 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:34.412 + for M in /var/spdk/build-*-manifest.txt 00:00:34.412 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:34.412 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:34.412 ++ uname 00:00:34.412 + [[ Linux == \L\i\n\u\x ]] 00:00:34.412 + sudo dmesg -T 00:00:34.412 + sudo dmesg --clear 00:00:34.412 + dmesg_pid=3186027 00:00:34.412 + [[ Fedora Linux == FreeBSD ]] 00:00:34.412 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:34.412 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:34.412 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:34.412 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:34.412 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:34.412 + [[ -x /usr/src/fio-static/fio ]] 00:00:34.412 + export FIO_BIN=/usr/src/fio-static/fio 00:00:34.412 + sudo dmesg -Tw 00:00:34.412 + FIO_BIN=/usr/src/fio-static/fio 00:00:34.412 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:34.412 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:34.412 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:34.412 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:34.412 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:34.412 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:34.412 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:34.412 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:34.412 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:34.412 Test configuration: 00:00:34.412 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:34.412 SPDK_TEST_NVMF=1 00:00:34.412 SPDK_TEST_NVME_CLI=1 00:00:34.412 SPDK_TEST_NVMF_NICS=mlx5 00:00:34.412 SPDK_RUN_UBSAN=1 00:00:34.412 NET_TYPE=phy 00:00:34.412 RUN_NIGHTLY=0 14:48:15 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:00:34.412 14:48:15 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:34.412 14:48:15 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:34.412 14:48:15 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:34.412 14:48:15 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:34.412 14:48:15 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:34.412 14:48:15 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:34.412 14:48:15 -- paths/export.sh@5 -- $ export PATH 00:00:34.412 14:48:15 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:34.412 14:48:15 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:00:34.412 14:48:15 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:34.412 14:48:15 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714135695.XXXXXX 00:00:34.412 14:48:15 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714135695.09BzYi 00:00:34.412 14:48:15 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:34.412 14:48:15 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:34.412 14:48:15 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:00:34.412 14:48:15 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:34.412 14:48:15 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:34.412 14:48:15 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:34.412 14:48:15 -- common/autotest_common.sh@395 -- $ xtrace_disable 00:00:34.412 14:48:15 -- common/autotest_common.sh@10 -- $ set +x 00:00:34.412 14:48:15 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:34.412 14:48:15 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:00:34.412 14:48:15 -- pm/common@17 -- $ local monitor 00:00:34.412 14:48:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:34.412 14:48:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3186061 00:00:34.412 14:48:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:34.412 14:48:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3186063 00:00:34.412 14:48:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:34.412 14:48:15 -- pm/common@21 -- $ date +%s 00:00:34.412 14:48:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3186065 00:00:34.412 14:48:15 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:34.412 14:48:15 -- pm/common@21 -- $ date +%s 00:00:34.412 14:48:15 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3186068 00:00:34.412 14:48:15 -- pm/common@26 -- $ sleep 1 00:00:34.412 14:48:15 -- pm/common@21 -- $ date +%s 00:00:34.412 14:48:15 -- pm/common@21 -- $ date +%s 00:00:34.412 14:48:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714135695 00:00:34.412 14:48:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714135695 00:00:34.412 14:48:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714135695 00:00:34.412 14:48:15 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714135695 00:00:34.412 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714135695_collect-cpu-load.pm.log 00:00:34.412 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714135695_collect-bmc-pm.bmc.pm.log 00:00:34.412 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714135695_collect-vmstat.pm.log 00:00:34.412 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714135695_collect-cpu-temp.pm.log 00:00:35.422 14:48:16 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:00:35.422 14:48:16 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:35.422 14:48:16 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:35.422 14:48:16 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:35.422 14:48:16 -- spdk/autobuild.sh@16 -- $ date -u 00:00:35.422 Fri Apr 26 12:48:16 PM UTC 2024 00:00:35.422 14:48:16 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:35.422 v24.05-pre-455-g52d0b12f9 00:00:35.422 14:48:16 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:35.422 14:48:16 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:35.422 14:48:16 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:35.422 14:48:16 -- common/autotest_common.sh@1097 -- $ '[' 3 -le 1 ']' 00:00:35.422 14:48:16 -- common/autotest_common.sh@1103 -- $ xtrace_disable 00:00:35.422 14:48:16 -- common/autotest_common.sh@10 -- $ set +x 00:00:35.422 ************************************ 00:00:35.422 START TEST ubsan 00:00:35.422 ************************************ 00:00:35.422 14:48:16 -- common/autotest_common.sh@1121 -- $ echo 'using ubsan' 00:00:35.422 using ubsan 00:00:35.422 00:00:35.422 real 0m0.000s 00:00:35.422 user 0m0.000s 00:00:35.422 sys 0m0.000s 00:00:35.422 14:48:16 -- common/autotest_common.sh@1122 -- $ xtrace_disable 00:00:35.422 14:48:16 -- common/autotest_common.sh@10 -- $ set +x 00:00:35.422 ************************************ 00:00:35.422 END TEST ubsan 00:00:35.422 ************************************ 00:00:35.422 14:48:16 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:35.422 14:48:16 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:35.422 14:48:16 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:35.422 14:48:16 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:35.683 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:00:35.683 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:00:35.944 Using 'verbs' RDMA provider 00:00:49.132 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:04.064 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:04.064 Creating mk/config.mk...done. 00:01:04.064 Creating mk/cc.flags.mk...done. 00:01:04.064 Type 'make' to build. 00:01:04.064 14:48:43 -- spdk/autobuild.sh@69 -- $ run_test make make -j144 00:01:04.064 14:48:43 -- common/autotest_common.sh@1097 -- $ '[' 3 -le 1 ']' 00:01:04.064 14:48:43 -- common/autotest_common.sh@1103 -- $ xtrace_disable 00:01:04.064 14:48:43 -- common/autotest_common.sh@10 -- $ set +x 00:01:04.064 ************************************ 00:01:04.064 START TEST make 00:01:04.064 ************************************ 00:01:04.064 14:48:44 -- common/autotest_common.sh@1121 -- $ make -j144 00:01:04.064 make[1]: Nothing to be done for 'all'. 00:01:12.213 The Meson build system 00:01:12.213 Version: 1.3.1 00:01:12.213 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:01:12.213 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:01:12.213 Build type: native build 00:01:12.213 Program cat found: YES (/usr/bin/cat) 00:01:12.213 Project name: DPDK 00:01:12.213 Project version: 23.11.0 00:01:12.213 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:12.213 C linker for the host machine: cc ld.bfd 2.39-16 00:01:12.213 Host machine cpu family: x86_64 00:01:12.213 Host machine cpu: x86_64 00:01:12.213 Message: ## Building in Developer Mode ## 00:01:12.213 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:12.213 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:12.213 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:12.213 Program python3 found: YES (/usr/bin/python3) 00:01:12.213 Program cat found: YES (/usr/bin/cat) 00:01:12.213 Compiler for C supports arguments -march=native: YES 00:01:12.213 Checking for size of "void *" : 8 00:01:12.213 Checking for size of "void *" : 8 (cached) 00:01:12.213 Library m found: YES 00:01:12.213 Library numa found: YES 00:01:12.213 Has header "numaif.h" : YES 00:01:12.213 Library fdt found: NO 00:01:12.213 Library execinfo found: NO 00:01:12.213 Has header "execinfo.h" : YES 00:01:12.213 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:12.213 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:12.213 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:12.213 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:12.213 Run-time dependency openssl found: YES 3.0.9 00:01:12.213 Run-time dependency libpcap found: YES 1.10.4 00:01:12.213 Has header "pcap.h" with dependency libpcap: YES 00:01:12.213 Compiler for C supports arguments -Wcast-qual: YES 00:01:12.213 Compiler for C supports arguments -Wdeprecated: YES 00:01:12.213 Compiler for C supports arguments -Wformat: YES 00:01:12.213 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:12.213 Compiler for C supports arguments -Wformat-security: NO 00:01:12.213 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:12.213 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:12.213 Compiler for C supports arguments -Wnested-externs: YES 00:01:12.213 Compiler for C supports arguments -Wold-style-definition: YES 00:01:12.213 Compiler for C supports arguments -Wpointer-arith: YES 00:01:12.213 Compiler for C supports arguments -Wsign-compare: YES 00:01:12.213 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:12.213 Compiler for C supports arguments -Wundef: YES 00:01:12.213 Compiler for C supports arguments -Wwrite-strings: YES 00:01:12.213 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:12.213 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:12.213 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:12.213 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:12.213 Program objdump found: YES (/usr/bin/objdump) 00:01:12.213 Compiler for C supports arguments -mavx512f: YES 00:01:12.213 Checking if "AVX512 checking" compiles: YES 00:01:12.213 Fetching value of define "__SSE4_2__" : 1 00:01:12.213 Fetching value of define "__AES__" : 1 00:01:12.213 Fetching value of define "__AVX__" : 1 00:01:12.213 Fetching value of define "__AVX2__" : 1 00:01:12.213 Fetching value of define "__AVX512BW__" : 1 00:01:12.213 Fetching value of define "__AVX512CD__" : 1 00:01:12.213 Fetching value of define "__AVX512DQ__" : 1 00:01:12.213 Fetching value of define "__AVX512F__" : 1 00:01:12.213 Fetching value of define "__AVX512VL__" : 1 00:01:12.213 Fetching value of define "__PCLMUL__" : 1 00:01:12.213 Fetching value of define "__RDRND__" : 1 00:01:12.213 Fetching value of define "__RDSEED__" : 1 00:01:12.213 Fetching value of define "__VPCLMULQDQ__" : 1 00:01:12.213 Fetching value of define "__znver1__" : (undefined) 00:01:12.213 Fetching value of define "__znver2__" : (undefined) 00:01:12.213 Fetching value of define "__znver3__" : (undefined) 00:01:12.213 Fetching value of define "__znver4__" : (undefined) 00:01:12.213 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:12.213 Message: lib/log: Defining dependency "log" 00:01:12.213 Message: lib/kvargs: Defining dependency "kvargs" 00:01:12.213 Message: lib/telemetry: Defining dependency "telemetry" 00:01:12.213 Checking for function "getentropy" : NO 00:01:12.213 Message: lib/eal: Defining dependency "eal" 00:01:12.213 Message: lib/ring: Defining dependency "ring" 00:01:12.213 Message: lib/rcu: Defining dependency "rcu" 00:01:12.213 Message: lib/mempool: Defining dependency "mempool" 00:01:12.213 Message: lib/mbuf: Defining dependency "mbuf" 00:01:12.213 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:12.213 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:12.213 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:12.213 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:12.213 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:12.213 Fetching value of define "__VPCLMULQDQ__" : 1 (cached) 00:01:12.213 Compiler for C supports arguments -mpclmul: YES 00:01:12.213 Compiler for C supports arguments -maes: YES 00:01:12.213 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:12.213 Compiler for C supports arguments -mavx512bw: YES 00:01:12.213 Compiler for C supports arguments -mavx512dq: YES 00:01:12.213 Compiler for C supports arguments -mavx512vl: YES 00:01:12.213 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:12.213 Compiler for C supports arguments -mavx2: YES 00:01:12.213 Compiler for C supports arguments -mavx: YES 00:01:12.213 Message: lib/net: Defining dependency "net" 00:01:12.213 Message: lib/meter: Defining dependency "meter" 00:01:12.213 Message: lib/ethdev: Defining dependency "ethdev" 00:01:12.213 Message: lib/pci: Defining dependency "pci" 00:01:12.213 Message: lib/cmdline: Defining dependency "cmdline" 00:01:12.213 Message: lib/hash: Defining dependency "hash" 00:01:12.213 Message: lib/timer: Defining dependency "timer" 00:01:12.213 Message: lib/compressdev: Defining dependency "compressdev" 00:01:12.213 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:12.213 Message: lib/dmadev: Defining dependency "dmadev" 00:01:12.214 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:12.214 Message: lib/power: Defining dependency "power" 00:01:12.214 Message: lib/reorder: Defining dependency "reorder" 00:01:12.214 Message: lib/security: Defining dependency "security" 00:01:12.214 Has header "linux/userfaultfd.h" : YES 00:01:12.214 Has header "linux/vduse.h" : YES 00:01:12.214 Message: lib/vhost: Defining dependency "vhost" 00:01:12.214 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:12.214 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:12.214 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:12.214 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:12.214 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:12.214 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:12.214 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:12.214 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:12.214 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:12.214 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:12.214 Program doxygen found: YES (/usr/bin/doxygen) 00:01:12.214 Configuring doxy-api-html.conf using configuration 00:01:12.214 Configuring doxy-api-man.conf using configuration 00:01:12.214 Program mandb found: YES (/usr/bin/mandb) 00:01:12.214 Program sphinx-build found: NO 00:01:12.214 Configuring rte_build_config.h using configuration 00:01:12.214 Message: 00:01:12.214 ================= 00:01:12.214 Applications Enabled 00:01:12.214 ================= 00:01:12.214 00:01:12.214 apps: 00:01:12.214 00:01:12.214 00:01:12.214 Message: 00:01:12.214 ================= 00:01:12.214 Libraries Enabled 00:01:12.214 ================= 00:01:12.214 00:01:12.214 libs: 00:01:12.214 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:12.214 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:12.214 cryptodev, dmadev, power, reorder, security, vhost, 00:01:12.214 00:01:12.214 Message: 00:01:12.214 =============== 00:01:12.214 Drivers Enabled 00:01:12.214 =============== 00:01:12.214 00:01:12.214 common: 00:01:12.214 00:01:12.214 bus: 00:01:12.214 pci, vdev, 00:01:12.214 mempool: 00:01:12.214 ring, 00:01:12.214 dma: 00:01:12.214 00:01:12.214 net: 00:01:12.214 00:01:12.214 crypto: 00:01:12.214 00:01:12.214 compress: 00:01:12.214 00:01:12.214 vdpa: 00:01:12.214 00:01:12.214 00:01:12.214 Message: 00:01:12.214 ================= 00:01:12.214 Content Skipped 00:01:12.214 ================= 00:01:12.214 00:01:12.214 apps: 00:01:12.214 dumpcap: explicitly disabled via build config 00:01:12.214 graph: explicitly disabled via build config 00:01:12.214 pdump: explicitly disabled via build config 00:01:12.214 proc-info: explicitly disabled via build config 00:01:12.214 test-acl: explicitly disabled via build config 00:01:12.214 test-bbdev: explicitly disabled via build config 00:01:12.214 test-cmdline: explicitly disabled via build config 00:01:12.214 test-compress-perf: explicitly disabled via build config 00:01:12.214 test-crypto-perf: explicitly disabled via build config 00:01:12.214 test-dma-perf: explicitly disabled via build config 00:01:12.214 test-eventdev: explicitly disabled via build config 00:01:12.214 test-fib: explicitly disabled via build config 00:01:12.214 test-flow-perf: explicitly disabled via build config 00:01:12.214 test-gpudev: explicitly disabled via build config 00:01:12.214 test-mldev: explicitly disabled via build config 00:01:12.214 test-pipeline: explicitly disabled via build config 00:01:12.214 test-pmd: explicitly disabled via build config 00:01:12.214 test-regex: explicitly disabled via build config 00:01:12.214 test-sad: explicitly disabled via build config 00:01:12.214 test-security-perf: explicitly disabled via build config 00:01:12.214 00:01:12.214 libs: 00:01:12.214 metrics: explicitly disabled via build config 00:01:12.214 acl: explicitly disabled via build config 00:01:12.214 bbdev: explicitly disabled via build config 00:01:12.214 bitratestats: explicitly disabled via build config 00:01:12.214 bpf: explicitly disabled via build config 00:01:12.214 cfgfile: explicitly disabled via build config 00:01:12.214 distributor: explicitly disabled via build config 00:01:12.214 efd: explicitly disabled via build config 00:01:12.214 eventdev: explicitly disabled via build config 00:01:12.214 dispatcher: explicitly disabled via build config 00:01:12.214 gpudev: explicitly disabled via build config 00:01:12.214 gro: explicitly disabled via build config 00:01:12.214 gso: explicitly disabled via build config 00:01:12.214 ip_frag: explicitly disabled via build config 00:01:12.214 jobstats: explicitly disabled via build config 00:01:12.214 latencystats: explicitly disabled via build config 00:01:12.214 lpm: explicitly disabled via build config 00:01:12.214 member: explicitly disabled via build config 00:01:12.214 pcapng: explicitly disabled via build config 00:01:12.214 rawdev: explicitly disabled via build config 00:01:12.214 regexdev: explicitly disabled via build config 00:01:12.214 mldev: explicitly disabled via build config 00:01:12.214 rib: explicitly disabled via build config 00:01:12.214 sched: explicitly disabled via build config 00:01:12.214 stack: explicitly disabled via build config 00:01:12.214 ipsec: explicitly disabled via build config 00:01:12.214 pdcp: explicitly disabled via build config 00:01:12.214 fib: explicitly disabled via build config 00:01:12.214 port: explicitly disabled via build config 00:01:12.214 pdump: explicitly disabled via build config 00:01:12.214 table: explicitly disabled via build config 00:01:12.214 pipeline: explicitly disabled via build config 00:01:12.214 graph: explicitly disabled via build config 00:01:12.214 node: explicitly disabled via build config 00:01:12.214 00:01:12.214 drivers: 00:01:12.214 common/cpt: not in enabled drivers build config 00:01:12.214 common/dpaax: not in enabled drivers build config 00:01:12.214 common/iavf: not in enabled drivers build config 00:01:12.214 common/idpf: not in enabled drivers build config 00:01:12.214 common/mvep: not in enabled drivers build config 00:01:12.214 common/octeontx: not in enabled drivers build config 00:01:12.214 bus/auxiliary: not in enabled drivers build config 00:01:12.214 bus/cdx: not in enabled drivers build config 00:01:12.214 bus/dpaa: not in enabled drivers build config 00:01:12.214 bus/fslmc: not in enabled drivers build config 00:01:12.214 bus/ifpga: not in enabled drivers build config 00:01:12.214 bus/platform: not in enabled drivers build config 00:01:12.214 bus/vmbus: not in enabled drivers build config 00:01:12.214 common/cnxk: not in enabled drivers build config 00:01:12.214 common/mlx5: not in enabled drivers build config 00:01:12.214 common/nfp: not in enabled drivers build config 00:01:12.214 common/qat: not in enabled drivers build config 00:01:12.214 common/sfc_efx: not in enabled drivers build config 00:01:12.214 mempool/bucket: not in enabled drivers build config 00:01:12.214 mempool/cnxk: not in enabled drivers build config 00:01:12.214 mempool/dpaa: not in enabled drivers build config 00:01:12.214 mempool/dpaa2: not in enabled drivers build config 00:01:12.214 mempool/octeontx: not in enabled drivers build config 00:01:12.214 mempool/stack: not in enabled drivers build config 00:01:12.214 dma/cnxk: not in enabled drivers build config 00:01:12.214 dma/dpaa: not in enabled drivers build config 00:01:12.214 dma/dpaa2: not in enabled drivers build config 00:01:12.214 dma/hisilicon: not in enabled drivers build config 00:01:12.214 dma/idxd: not in enabled drivers build config 00:01:12.214 dma/ioat: not in enabled drivers build config 00:01:12.214 dma/skeleton: not in enabled drivers build config 00:01:12.214 net/af_packet: not in enabled drivers build config 00:01:12.214 net/af_xdp: not in enabled drivers build config 00:01:12.214 net/ark: not in enabled drivers build config 00:01:12.214 net/atlantic: not in enabled drivers build config 00:01:12.214 net/avp: not in enabled drivers build config 00:01:12.214 net/axgbe: not in enabled drivers build config 00:01:12.214 net/bnx2x: not in enabled drivers build config 00:01:12.214 net/bnxt: not in enabled drivers build config 00:01:12.214 net/bonding: not in enabled drivers build config 00:01:12.214 net/cnxk: not in enabled drivers build config 00:01:12.214 net/cpfl: not in enabled drivers build config 00:01:12.214 net/cxgbe: not in enabled drivers build config 00:01:12.214 net/dpaa: not in enabled drivers build config 00:01:12.214 net/dpaa2: not in enabled drivers build config 00:01:12.214 net/e1000: not in enabled drivers build config 00:01:12.214 net/ena: not in enabled drivers build config 00:01:12.214 net/enetc: not in enabled drivers build config 00:01:12.214 net/enetfec: not in enabled drivers build config 00:01:12.214 net/enic: not in enabled drivers build config 00:01:12.214 net/failsafe: not in enabled drivers build config 00:01:12.214 net/fm10k: not in enabled drivers build config 00:01:12.214 net/gve: not in enabled drivers build config 00:01:12.214 net/hinic: not in enabled drivers build config 00:01:12.214 net/hns3: not in enabled drivers build config 00:01:12.214 net/i40e: not in enabled drivers build config 00:01:12.214 net/iavf: not in enabled drivers build config 00:01:12.214 net/ice: not in enabled drivers build config 00:01:12.214 net/idpf: not in enabled drivers build config 00:01:12.214 net/igc: not in enabled drivers build config 00:01:12.214 net/ionic: not in enabled drivers build config 00:01:12.214 net/ipn3ke: not in enabled drivers build config 00:01:12.214 net/ixgbe: not in enabled drivers build config 00:01:12.214 net/mana: not in enabled drivers build config 00:01:12.214 net/memif: not in enabled drivers build config 00:01:12.214 net/mlx4: not in enabled drivers build config 00:01:12.214 net/mlx5: not in enabled drivers build config 00:01:12.214 net/mvneta: not in enabled drivers build config 00:01:12.214 net/mvpp2: not in enabled drivers build config 00:01:12.214 net/netvsc: not in enabled drivers build config 00:01:12.214 net/nfb: not in enabled drivers build config 00:01:12.214 net/nfp: not in enabled drivers build config 00:01:12.214 net/ngbe: not in enabled drivers build config 00:01:12.214 net/null: not in enabled drivers build config 00:01:12.214 net/octeontx: not in enabled drivers build config 00:01:12.215 net/octeon_ep: not in enabled drivers build config 00:01:12.215 net/pcap: not in enabled drivers build config 00:01:12.215 net/pfe: not in enabled drivers build config 00:01:12.215 net/qede: not in enabled drivers build config 00:01:12.215 net/ring: not in enabled drivers build config 00:01:12.215 net/sfc: not in enabled drivers build config 00:01:12.215 net/softnic: not in enabled drivers build config 00:01:12.215 net/tap: not in enabled drivers build config 00:01:12.215 net/thunderx: not in enabled drivers build config 00:01:12.215 net/txgbe: not in enabled drivers build config 00:01:12.215 net/vdev_netvsc: not in enabled drivers build config 00:01:12.215 net/vhost: not in enabled drivers build config 00:01:12.215 net/virtio: not in enabled drivers build config 00:01:12.215 net/vmxnet3: not in enabled drivers build config 00:01:12.215 raw/*: missing internal dependency, "rawdev" 00:01:12.215 crypto/armv8: not in enabled drivers build config 00:01:12.215 crypto/bcmfs: not in enabled drivers build config 00:01:12.215 crypto/caam_jr: not in enabled drivers build config 00:01:12.215 crypto/ccp: not in enabled drivers build config 00:01:12.215 crypto/cnxk: not in enabled drivers build config 00:01:12.215 crypto/dpaa_sec: not in enabled drivers build config 00:01:12.215 crypto/dpaa2_sec: not in enabled drivers build config 00:01:12.215 crypto/ipsec_mb: not in enabled drivers build config 00:01:12.215 crypto/mlx5: not in enabled drivers build config 00:01:12.215 crypto/mvsam: not in enabled drivers build config 00:01:12.215 crypto/nitrox: not in enabled drivers build config 00:01:12.215 crypto/null: not in enabled drivers build config 00:01:12.215 crypto/octeontx: not in enabled drivers build config 00:01:12.215 crypto/openssl: not in enabled drivers build config 00:01:12.215 crypto/scheduler: not in enabled drivers build config 00:01:12.215 crypto/uadk: not in enabled drivers build config 00:01:12.215 crypto/virtio: not in enabled drivers build config 00:01:12.215 compress/isal: not in enabled drivers build config 00:01:12.215 compress/mlx5: not in enabled drivers build config 00:01:12.215 compress/octeontx: not in enabled drivers build config 00:01:12.215 compress/zlib: not in enabled drivers build config 00:01:12.215 regex/*: missing internal dependency, "regexdev" 00:01:12.215 ml/*: missing internal dependency, "mldev" 00:01:12.215 vdpa/ifc: not in enabled drivers build config 00:01:12.215 vdpa/mlx5: not in enabled drivers build config 00:01:12.215 vdpa/nfp: not in enabled drivers build config 00:01:12.215 vdpa/sfc: not in enabled drivers build config 00:01:12.215 event/*: missing internal dependency, "eventdev" 00:01:12.215 baseband/*: missing internal dependency, "bbdev" 00:01:12.215 gpu/*: missing internal dependency, "gpudev" 00:01:12.215 00:01:12.215 00:01:12.215 Build targets in project: 84 00:01:12.215 00:01:12.215 DPDK 23.11.0 00:01:12.215 00:01:12.215 User defined options 00:01:12.215 buildtype : debug 00:01:12.215 default_library : shared 00:01:12.215 libdir : lib 00:01:12.215 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:12.215 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:12.215 c_link_args : 00:01:12.215 cpu_instruction_set: native 00:01:12.215 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:12.215 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:12.215 enable_docs : false 00:01:12.215 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:12.215 enable_kmods : false 00:01:12.215 tests : false 00:01:12.215 00:01:12.215 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:12.215 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:01:12.215 [1/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:12.215 [2/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:12.215 [3/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:12.215 [4/264] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:12.215 [5/264] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:12.215 [6/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:12.478 [7/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:12.478 [8/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:12.478 [9/264] Linking static target lib/librte_kvargs.a 00:01:12.478 [10/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:12.478 [11/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:12.478 [12/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:12.478 [13/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:12.478 [14/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:12.478 [15/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:12.478 [16/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:12.478 [17/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:12.478 [18/264] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:12.478 [19/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:12.478 [20/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:12.478 [21/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:12.478 [22/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:12.478 [23/264] Linking static target lib/librte_log.a 00:01:12.478 [24/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:12.478 [25/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:12.478 [26/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:12.478 [27/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:12.478 [28/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:12.478 [29/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:12.478 [30/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:12.478 [31/264] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:12.478 [32/264] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:12.478 [33/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:12.478 [34/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:12.478 [35/264] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:12.478 [36/264] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:12.478 [37/264] Linking static target lib/librte_pci.a 00:01:12.736 [38/264] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:12.736 [39/264] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:12.736 [40/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:12.736 [41/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:12.736 [42/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:12.736 [43/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:12.736 [44/264] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:12.736 [45/264] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.736 [46/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:12.736 [47/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:12.736 [48/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:12.736 [49/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:12.736 [50/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:12.736 [51/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:12.737 [52/264] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.737 [53/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:12.737 [54/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:12.737 [55/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:12.737 [56/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:12.737 [57/264] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:12.737 [58/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:12.737 [59/264] Linking static target lib/librte_ring.a 00:01:12.998 [60/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:12.998 [61/264] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:12.998 [62/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:12.998 [63/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:12.998 [64/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:12.998 [65/264] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:12.998 [66/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:12.998 [67/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:12.998 [68/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:12.998 [69/264] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:12.998 [70/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:12.998 [71/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:12.998 [72/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:12.998 [73/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:12.998 [74/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:12.998 [75/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:12.998 [76/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:12.998 [77/264] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:12.998 [78/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:12.998 [79/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:12.998 [80/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:12.998 [81/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:12.998 [82/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:12.998 [83/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:12.998 [84/264] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:12.998 [85/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:12.998 [86/264] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:12.998 [87/264] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:12.998 [88/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:12.998 [89/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:12.998 [90/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:12.998 [91/264] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:12.998 [92/264] Linking static target lib/librte_meter.a 00:01:12.998 [93/264] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:12.998 [94/264] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:12.998 [95/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:12.998 [96/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:12.998 [97/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:12.998 [98/264] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:12.998 [99/264] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:12.998 [100/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:12.998 [101/264] Linking static target lib/librte_timer.a 00:01:12.998 [102/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:12.998 [103/264] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:12.998 [104/264] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:12.998 [105/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:12.998 [106/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:12.998 [107/264] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:12.998 [108/264] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:12.998 [109/264] Compiling C object lib/librte_net.a.p/net_net_crc_avx512.c.o 00:01:12.998 [110/264] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:12.998 [111/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:12.998 [112/264] Linking static target lib/librte_telemetry.a 00:01:12.998 [113/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:12.998 [114/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:12.998 [115/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:12.998 [116/264] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:12.998 [117/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:12.998 [118/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:12.998 [119/264] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:12.999 [120/264] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:12.999 [121/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:12.999 [122/264] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:12.999 [123/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:12.999 [124/264] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:12.999 [125/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:12.999 [126/264] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:12.999 [127/264] Linking static target lib/librte_net.a 00:01:12.999 [128/264] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:12.999 [129/264] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:12.999 [130/264] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:12.999 [131/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:12.999 [132/264] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:12.999 [133/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:12.999 [134/264] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:12.999 [135/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:12.999 [136/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:12.999 [137/264] Linking static target lib/librte_mempool.a 00:01:12.999 [138/264] Linking static target lib/librte_rcu.a 00:01:12.999 [139/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:12.999 [140/264] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:12.999 [141/264] Linking static target lib/librte_cmdline.a 00:01:12.999 [142/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:12.999 [143/264] Linking static target lib/librte_power.a 00:01:12.999 [144/264] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:12.999 [145/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:12.999 [146/264] Linking static target lib/librte_mbuf.a 00:01:12.999 [147/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:12.999 [148/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:12.999 [149/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:12.999 [150/264] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:12.999 [151/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:12.999 [152/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:12.999 [153/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:12.999 [154/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:12.999 [155/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:12.999 [156/264] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.999 [157/264] Linking static target lib/librte_compressdev.a 00:01:12.999 [158/264] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:12.999 [159/264] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:12.999 [160/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:12.999 [161/264] Linking static target lib/librte_dmadev.a 00:01:12.999 [162/264] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:13.302 [163/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:13.302 [164/264] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:13.302 [165/264] Linking target lib/librte_log.so.24.0 00:01:13.302 [166/264] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:13.302 [167/264] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:13.302 [168/264] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:13.302 [169/264] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:13.302 [170/264] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:13.302 [171/264] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.302 [172/264] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:13.302 [173/264] Linking static target lib/librte_eal.a 00:01:13.302 [174/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:13.302 [175/264] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:13.302 [176/264] Linking static target lib/librte_reorder.a 00:01:13.302 [177/264] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:13.302 [178/264] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:13.302 [179/264] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.302 [180/264] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:13.302 [181/264] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:13.302 [182/264] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:13.302 [183/264] Linking static target drivers/librte_bus_vdev.a 00:01:13.302 [184/264] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:13.302 [185/264] Linking target lib/librte_kvargs.so.24.0 00:01:13.302 [186/264] Linking static target lib/librte_security.a 00:01:13.302 [187/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:13.302 [188/264] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:13.302 [189/264] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:13.302 [190/264] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:13.302 [191/264] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:13.302 [192/264] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:13.302 [193/264] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.302 [194/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:13.302 [195/264] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:13.302 [196/264] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:13.302 [197/264] Linking static target drivers/librte_mempool_ring.a 00:01:13.302 [198/264] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:13.302 [199/264] Linking static target drivers/librte_bus_pci.a 00:01:13.302 [200/264] Linking static target lib/librte_hash.a 00:01:13.302 [201/264] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.302 [202/264] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:13.302 [203/264] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:13.566 [204/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:13.566 [205/264] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.566 [206/264] Linking static target lib/librte_cryptodev.a 00:01:13.566 [207/264] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.566 [208/264] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.566 [209/264] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.566 [210/264] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.827 [211/264] Linking target lib/librte_telemetry.so.24.0 00:01:13.827 [212/264] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:13.827 [213/264] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:13.827 [214/264] Linking static target lib/librte_ethdev.a 00:01:13.827 [215/264] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.827 [216/264] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:13.827 [217/264] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.827 [218/264] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.088 [219/264] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.088 [220/264] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.088 [221/264] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.351 [222/264] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.351 [223/264] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.923 [224/264] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:14.923 [225/264] Linking static target lib/librte_vhost.a 00:01:15.496 [226/264] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.412 [227/264] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.735 [228/264] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.650 [229/264] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.650 [230/264] Linking target lib/librte_eal.so.24.0 00:01:24.650 [231/264] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:24.650 [232/264] Linking target lib/librte_timer.so.24.0 00:01:24.650 [233/264] Linking target drivers/librte_bus_vdev.so.24.0 00:01:24.650 [234/264] Linking target lib/librte_ring.so.24.0 00:01:24.650 [235/264] Linking target lib/librte_meter.so.24.0 00:01:24.650 [236/264] Linking target lib/librte_pci.so.24.0 00:01:24.650 [237/264] Linking target lib/librte_dmadev.so.24.0 00:01:24.650 [238/264] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:24.650 [239/264] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:24.650 [240/264] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:24.650 [241/264] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:24.650 [242/264] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:24.650 [243/264] Linking target lib/librte_rcu.so.24.0 00:01:24.650 [244/264] Linking target lib/librte_mempool.so.24.0 00:01:24.650 [245/264] Linking target drivers/librte_bus_pci.so.24.0 00:01:24.912 [246/264] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:24.912 [247/264] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:24.912 [248/264] Linking target lib/librte_mbuf.so.24.0 00:01:24.912 [249/264] Linking target drivers/librte_mempool_ring.so.24.0 00:01:24.912 [250/264] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:25.174 [251/264] Linking target lib/librte_cryptodev.so.24.0 00:01:25.174 [252/264] Linking target lib/librte_reorder.so.24.0 00:01:25.174 [253/264] Linking target lib/librte_compressdev.so.24.0 00:01:25.174 [254/264] Linking target lib/librte_net.so.24.0 00:01:25.174 [255/264] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:25.174 [256/264] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:25.174 [257/264] Linking target lib/librte_cmdline.so.24.0 00:01:25.174 [258/264] Linking target lib/librte_security.so.24.0 00:01:25.174 [259/264] Linking target lib/librte_hash.so.24.0 00:01:25.174 [260/264] Linking target lib/librte_ethdev.so.24.0 00:01:25.434 [261/264] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:25.434 [262/264] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:25.434 [263/264] Linking target lib/librte_power.so.24.0 00:01:25.434 [264/264] Linking target lib/librte_vhost.so.24.0 00:01:25.434 INFO: autodetecting backend as ninja 00:01:25.434 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 144 00:01:26.820 CC lib/log/log.o 00:01:26.820 CC lib/log/log_flags.o 00:01:26.820 CC lib/log/log_deprecated.o 00:01:26.820 CC lib/ut/ut.o 00:01:26.820 CC lib/ut_mock/mock.o 00:01:26.820 LIB libspdk_ut_mock.a 00:01:26.820 LIB libspdk_log.a 00:01:26.820 LIB libspdk_ut.a 00:01:26.820 SO libspdk_ut_mock.so.6.0 00:01:26.820 SO libspdk_log.so.7.0 00:01:26.820 SO libspdk_ut.so.2.0 00:01:26.820 SYMLINK libspdk_log.so 00:01:26.820 SYMLINK libspdk_ut_mock.so 00:01:26.820 SYMLINK libspdk_ut.so 00:01:27.082 CC lib/ioat/ioat.o 00:01:27.082 CXX lib/trace_parser/trace.o 00:01:27.082 CC lib/util/base64.o 00:01:27.082 CC lib/util/bit_array.o 00:01:27.082 CC lib/util/cpuset.o 00:01:27.082 CC lib/util/crc16.o 00:01:27.082 CC lib/util/crc32.o 00:01:27.082 CC lib/dma/dma.o 00:01:27.082 CC lib/util/crc32c.o 00:01:27.082 CC lib/util/crc32_ieee.o 00:01:27.082 CC lib/util/crc64.o 00:01:27.082 CC lib/util/dif.o 00:01:27.082 CC lib/util/fd.o 00:01:27.082 CC lib/util/file.o 00:01:27.082 CC lib/util/hexlify.o 00:01:27.082 CC lib/util/math.o 00:01:27.082 CC lib/util/iov.o 00:01:27.082 CC lib/util/pipe.o 00:01:27.082 CC lib/util/strerror_tls.o 00:01:27.082 CC lib/util/string.o 00:01:27.082 CC lib/util/uuid.o 00:01:27.082 CC lib/util/fd_group.o 00:01:27.082 CC lib/util/xor.o 00:01:27.082 CC lib/util/zipf.o 00:01:27.343 CC lib/vfio_user/host/vfio_user.o 00:01:27.343 CC lib/vfio_user/host/vfio_user_pci.o 00:01:27.343 LIB libspdk_ioat.a 00:01:27.343 LIB libspdk_dma.a 00:01:27.343 SO libspdk_ioat.so.7.0 00:01:27.343 SO libspdk_dma.so.4.0 00:01:27.343 SYMLINK libspdk_ioat.so 00:01:27.343 SYMLINK libspdk_dma.so 00:01:27.604 LIB libspdk_vfio_user.a 00:01:27.604 SO libspdk_vfio_user.so.5.0 00:01:27.604 LIB libspdk_util.a 00:01:27.604 SYMLINK libspdk_vfio_user.so 00:01:27.604 SO libspdk_util.so.9.0 00:01:27.865 SYMLINK libspdk_util.so 00:01:27.865 LIB libspdk_trace_parser.a 00:01:27.865 SO libspdk_trace_parser.so.5.0 00:01:28.125 SYMLINK libspdk_trace_parser.so 00:01:28.125 CC lib/rdma/common.o 00:01:28.125 CC lib/rdma/rdma_verbs.o 00:01:28.125 CC lib/env_dpdk/env.o 00:01:28.125 CC lib/env_dpdk/memory.o 00:01:28.125 CC lib/vmd/vmd.o 00:01:28.125 CC lib/env_dpdk/pci.o 00:01:28.125 CC lib/vmd/led.o 00:01:28.125 CC lib/env_dpdk/init.o 00:01:28.125 CC lib/idxd/idxd.o 00:01:28.125 CC lib/env_dpdk/threads.o 00:01:28.125 CC lib/env_dpdk/pci_ioat.o 00:01:28.125 CC lib/idxd/idxd_user.o 00:01:28.125 CC lib/env_dpdk/pci_virtio.o 00:01:28.125 CC lib/env_dpdk/pci_vmd.o 00:01:28.125 CC lib/env_dpdk/pci_idxd.o 00:01:28.125 CC lib/env_dpdk/pci_event.o 00:01:28.125 CC lib/json/json_parse.o 00:01:28.125 CC lib/conf/conf.o 00:01:28.125 CC lib/env_dpdk/sigbus_handler.o 00:01:28.125 CC lib/json/json_util.o 00:01:28.125 CC lib/env_dpdk/pci_dpdk.o 00:01:28.125 CC lib/json/json_write.o 00:01:28.125 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:28.125 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:28.387 LIB libspdk_conf.a 00:01:28.387 LIB libspdk_rdma.a 00:01:28.387 LIB libspdk_json.a 00:01:28.387 SO libspdk_conf.so.6.0 00:01:28.648 SO libspdk_rdma.so.6.0 00:01:28.648 SO libspdk_json.so.6.0 00:01:28.648 SYMLINK libspdk_conf.so 00:01:28.648 SYMLINK libspdk_rdma.so 00:01:28.648 SYMLINK libspdk_json.so 00:01:28.648 LIB libspdk_idxd.a 00:01:28.648 SO libspdk_idxd.so.12.0 00:01:28.908 LIB libspdk_vmd.a 00:01:28.908 SO libspdk_vmd.so.6.0 00:01:28.908 SYMLINK libspdk_idxd.so 00:01:28.908 SYMLINK libspdk_vmd.so 00:01:28.908 CC lib/jsonrpc/jsonrpc_server.o 00:01:28.908 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:28.908 CC lib/jsonrpc/jsonrpc_client.o 00:01:28.908 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:29.168 LIB libspdk_jsonrpc.a 00:01:29.168 SO libspdk_jsonrpc.so.6.0 00:01:29.428 SYMLINK libspdk_jsonrpc.so 00:01:29.428 LIB libspdk_env_dpdk.a 00:01:29.428 SO libspdk_env_dpdk.so.14.0 00:01:29.688 SYMLINK libspdk_env_dpdk.so 00:01:29.688 CC lib/rpc/rpc.o 00:01:29.950 LIB libspdk_rpc.a 00:01:29.950 SO libspdk_rpc.so.6.0 00:01:29.950 SYMLINK libspdk_rpc.so 00:01:30.523 CC lib/trace/trace.o 00:01:30.523 CC lib/trace/trace_rpc.o 00:01:30.523 CC lib/trace/trace_flags.o 00:01:30.523 CC lib/notify/notify.o 00:01:30.523 CC lib/notify/notify_rpc.o 00:01:30.523 CC lib/keyring/keyring.o 00:01:30.523 CC lib/keyring/keyring_rpc.o 00:01:30.523 LIB libspdk_notify.a 00:01:30.523 SO libspdk_notify.so.6.0 00:01:30.523 LIB libspdk_keyring.a 00:01:30.523 LIB libspdk_trace.a 00:01:30.784 SO libspdk_keyring.so.1.0 00:01:30.784 SO libspdk_trace.so.10.0 00:01:30.784 SYMLINK libspdk_notify.so 00:01:30.784 SYMLINK libspdk_keyring.so 00:01:30.784 SYMLINK libspdk_trace.so 00:01:31.132 CC lib/sock/sock.o 00:01:31.132 CC lib/sock/sock_rpc.o 00:01:31.132 CC lib/thread/thread.o 00:01:31.132 CC lib/thread/iobuf.o 00:01:31.431 LIB libspdk_sock.a 00:01:31.431 SO libspdk_sock.so.9.0 00:01:31.431 SYMLINK libspdk_sock.so 00:01:32.004 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:32.004 CC lib/nvme/nvme_ctrlr.o 00:01:32.004 CC lib/nvme/nvme_ns_cmd.o 00:01:32.004 CC lib/nvme/nvme_fabric.o 00:01:32.004 CC lib/nvme/nvme_ns.o 00:01:32.004 CC lib/nvme/nvme_qpair.o 00:01:32.004 CC lib/nvme/nvme_pcie_common.o 00:01:32.004 CC lib/nvme/nvme_pcie.o 00:01:32.004 CC lib/nvme/nvme_quirks.o 00:01:32.004 CC lib/nvme/nvme_transport.o 00:01:32.004 CC lib/nvme/nvme.o 00:01:32.004 CC lib/nvme/nvme_discovery.o 00:01:32.004 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:32.004 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:32.004 CC lib/nvme/nvme_tcp.o 00:01:32.004 CC lib/nvme/nvme_opal.o 00:01:32.004 CC lib/nvme/nvme_io_msg.o 00:01:32.004 CC lib/nvme/nvme_poll_group.o 00:01:32.004 CC lib/nvme/nvme_zns.o 00:01:32.004 CC lib/nvme/nvme_stubs.o 00:01:32.004 CC lib/nvme/nvme_auth.o 00:01:32.004 CC lib/nvme/nvme_cuse.o 00:01:32.004 CC lib/nvme/nvme_rdma.o 00:01:32.265 LIB libspdk_thread.a 00:01:32.265 SO libspdk_thread.so.10.0 00:01:32.525 SYMLINK libspdk_thread.so 00:01:32.820 CC lib/init/subsystem_rpc.o 00:01:32.820 CC lib/init/json_config.o 00:01:32.820 CC lib/init/subsystem.o 00:01:32.820 CC lib/init/rpc.o 00:01:32.820 CC lib/accel/accel.o 00:01:32.820 CC lib/accel/accel_rpc.o 00:01:32.820 CC lib/virtio/virtio.o 00:01:32.820 CC lib/blob/request.o 00:01:32.820 CC lib/accel/accel_sw.o 00:01:32.820 CC lib/virtio/virtio_vhost_user.o 00:01:32.820 CC lib/blob/blobstore.o 00:01:32.820 CC lib/blob/blob_bs_dev.o 00:01:32.820 CC lib/virtio/virtio_vfio_user.o 00:01:32.820 CC lib/blob/zeroes.o 00:01:32.820 CC lib/virtio/virtio_pci.o 00:01:33.082 LIB libspdk_init.a 00:01:33.082 SO libspdk_init.so.5.0 00:01:33.082 LIB libspdk_virtio.a 00:01:33.082 SYMLINK libspdk_init.so 00:01:33.082 SO libspdk_virtio.so.7.0 00:01:33.344 SYMLINK libspdk_virtio.so 00:01:33.344 CC lib/event/app.o 00:01:33.344 CC lib/event/reactor.o 00:01:33.344 CC lib/event/log_rpc.o 00:01:33.344 CC lib/event/app_rpc.o 00:01:33.344 CC lib/event/scheduler_static.o 00:01:33.606 LIB libspdk_accel.a 00:01:33.606 LIB libspdk_nvme.a 00:01:33.606 SO libspdk_accel.so.15.0 00:01:33.868 SO libspdk_nvme.so.13.0 00:01:33.868 SYMLINK libspdk_accel.so 00:01:33.868 LIB libspdk_event.a 00:01:33.868 SO libspdk_event.so.13.0 00:01:33.868 SYMLINK libspdk_event.so 00:01:34.131 SYMLINK libspdk_nvme.so 00:01:34.131 CC lib/bdev/bdev.o 00:01:34.131 CC lib/bdev/bdev_rpc.o 00:01:34.131 CC lib/bdev/bdev_zone.o 00:01:34.131 CC lib/bdev/part.o 00:01:34.131 CC lib/bdev/scsi_nvme.o 00:01:35.074 LIB libspdk_blob.a 00:01:35.074 SO libspdk_blob.so.11.0 00:01:35.336 SYMLINK libspdk_blob.so 00:01:35.597 CC lib/blobfs/blobfs.o 00:01:35.597 CC lib/blobfs/tree.o 00:01:35.597 CC lib/lvol/lvol.o 00:01:36.168 LIB libspdk_blobfs.a 00:01:36.168 LIB libspdk_bdev.a 00:01:36.430 SO libspdk_blobfs.so.10.0 00:01:36.430 SO libspdk_bdev.so.15.0 00:01:36.430 LIB libspdk_lvol.a 00:01:36.430 SYMLINK libspdk_blobfs.so 00:01:36.430 SO libspdk_lvol.so.10.0 00:01:36.430 SYMLINK libspdk_bdev.so 00:01:36.430 SYMLINK libspdk_lvol.so 00:01:36.691 CC lib/ublk/ublk.o 00:01:36.691 CC lib/ublk/ublk_rpc.o 00:01:36.691 CC lib/nvmf/ctrlr.o 00:01:36.691 CC lib/nvmf/ctrlr_discovery.o 00:01:36.691 CC lib/nvmf/subsystem.o 00:01:36.691 CC lib/nvmf/ctrlr_bdev.o 00:01:36.691 CC lib/scsi/dev.o 00:01:36.691 CC lib/scsi/port.o 00:01:36.691 CC lib/scsi/scsi.o 00:01:36.691 CC lib/scsi/lun.o 00:01:36.691 CC lib/nvmf/nvmf.o 00:01:36.691 CC lib/nvmf/nvmf_rpc.o 00:01:36.691 CC lib/nvmf/rdma.o 00:01:36.691 CC lib/nvmf/transport.o 00:01:36.691 CC lib/nbd/nbd.o 00:01:36.691 CC lib/scsi/scsi_bdev.o 00:01:36.691 CC lib/nvmf/tcp.o 00:01:36.691 CC lib/nbd/nbd_rpc.o 00:01:36.691 CC lib/scsi/scsi_pr.o 00:01:36.691 CC lib/scsi/scsi_rpc.o 00:01:36.691 CC lib/scsi/task.o 00:01:36.691 CC lib/ftl/ftl_core.o 00:01:36.691 CC lib/ftl/ftl_init.o 00:01:36.691 CC lib/ftl/ftl_layout.o 00:01:36.691 CC lib/ftl/ftl_debug.o 00:01:36.952 CC lib/ftl/ftl_io.o 00:01:36.952 CC lib/ftl/ftl_sb.o 00:01:36.952 CC lib/ftl/ftl_l2p.o 00:01:36.952 CC lib/ftl/ftl_l2p_flat.o 00:01:36.952 CC lib/ftl/ftl_nv_cache.o 00:01:36.952 CC lib/ftl/ftl_band.o 00:01:36.952 CC lib/ftl/ftl_band_ops.o 00:01:36.952 CC lib/ftl/ftl_writer.o 00:01:36.952 CC lib/ftl/ftl_rq.o 00:01:36.952 CC lib/ftl/ftl_reloc.o 00:01:36.952 CC lib/ftl/ftl_l2p_cache.o 00:01:36.952 CC lib/ftl/ftl_p2l.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:36.952 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:36.952 CC lib/ftl/utils/ftl_conf.o 00:01:36.952 CC lib/ftl/utils/ftl_md.o 00:01:36.952 CC lib/ftl/utils/ftl_mempool.o 00:01:36.952 CC lib/ftl/utils/ftl_bitmap.o 00:01:36.952 CC lib/ftl/utils/ftl_property.o 00:01:36.952 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:36.952 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:36.952 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:36.952 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:36.952 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:36.952 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:36.952 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:36.952 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:36.952 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:36.952 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:36.952 CC lib/ftl/base/ftl_base_dev.o 00:01:36.952 CC lib/ftl/base/ftl_base_bdev.o 00:01:36.952 CC lib/ftl/ftl_trace.o 00:01:37.522 LIB libspdk_scsi.a 00:01:37.522 LIB libspdk_nbd.a 00:01:37.522 SO libspdk_nbd.so.7.0 00:01:37.522 SO libspdk_scsi.so.9.0 00:01:37.522 LIB libspdk_ublk.a 00:01:37.522 SO libspdk_ublk.so.3.0 00:01:37.522 SYMLINK libspdk_nbd.so 00:01:37.522 SYMLINK libspdk_scsi.so 00:01:37.522 SYMLINK libspdk_ublk.so 00:01:37.782 LIB libspdk_ftl.a 00:01:37.782 CC lib/iscsi/conn.o 00:01:37.783 CC lib/iscsi/init_grp.o 00:01:37.783 CC lib/iscsi/iscsi.o 00:01:37.783 CC lib/iscsi/md5.o 00:01:37.783 CC lib/iscsi/param.o 00:01:37.783 CC lib/iscsi/portal_grp.o 00:01:37.783 CC lib/iscsi/tgt_node.o 00:01:37.783 CC lib/iscsi/iscsi_subsystem.o 00:01:37.783 CC lib/iscsi/iscsi_rpc.o 00:01:37.783 CC lib/iscsi/task.o 00:01:37.783 CC lib/vhost/vhost.o 00:01:37.783 CC lib/vhost/vhost_rpc.o 00:01:37.783 CC lib/vhost/vhost_scsi.o 00:01:37.783 CC lib/vhost/vhost_blk.o 00:01:37.783 CC lib/vhost/rte_vhost_user.o 00:01:37.783 SO libspdk_ftl.so.9.0 00:01:38.353 SYMLINK libspdk_ftl.so 00:01:38.613 LIB libspdk_nvmf.a 00:01:38.613 SO libspdk_nvmf.so.18.0 00:01:38.613 LIB libspdk_vhost.a 00:01:38.874 SO libspdk_vhost.so.8.0 00:01:38.874 SYMLINK libspdk_nvmf.so 00:01:38.874 SYMLINK libspdk_vhost.so 00:01:38.874 LIB libspdk_iscsi.a 00:01:38.874 SO libspdk_iscsi.so.8.0 00:01:39.136 SYMLINK libspdk_iscsi.so 00:01:39.711 CC module/env_dpdk/env_dpdk_rpc.o 00:01:39.711 CC module/accel/ioat/accel_ioat.o 00:01:39.711 CC module/accel/ioat/accel_ioat_rpc.o 00:01:39.711 CC module/accel/error/accel_error_rpc.o 00:01:39.711 CC module/accel/error/accel_error.o 00:01:39.711 CC module/accel/dsa/accel_dsa.o 00:01:39.711 CC module/accel/dsa/accel_dsa_rpc.o 00:01:39.711 CC module/sock/posix/posix.o 00:01:39.972 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:39.972 LIB libspdk_env_dpdk_rpc.a 00:01:39.972 CC module/scheduler/gscheduler/gscheduler.o 00:01:39.972 CC module/accel/iaa/accel_iaa.o 00:01:39.972 CC module/keyring/file/keyring.o 00:01:39.972 CC module/accel/iaa/accel_iaa_rpc.o 00:01:39.972 CC module/keyring/file/keyring_rpc.o 00:01:39.972 CC module/blob/bdev/blob_bdev.o 00:01:39.972 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:39.972 SO libspdk_env_dpdk_rpc.so.6.0 00:01:39.972 SYMLINK libspdk_env_dpdk_rpc.so 00:01:39.972 LIB libspdk_keyring_file.a 00:01:39.972 LIB libspdk_accel_error.a 00:01:39.972 LIB libspdk_accel_ioat.a 00:01:39.972 LIB libspdk_scheduler_gscheduler.a 00:01:39.972 LIB libspdk_scheduler_dpdk_governor.a 00:01:39.972 SO libspdk_accel_error.so.2.0 00:01:39.972 SO libspdk_keyring_file.so.1.0 00:01:39.972 SO libspdk_accel_ioat.so.6.0 00:01:39.972 LIB libspdk_scheduler_dynamic.a 00:01:39.972 SO libspdk_scheduler_gscheduler.so.4.0 00:01:39.972 LIB libspdk_accel_iaa.a 00:01:39.972 SO libspdk_scheduler_dpdk_governor.so.4.0 00:01:39.972 LIB libspdk_accel_dsa.a 00:01:39.972 SO libspdk_scheduler_dynamic.so.4.0 00:01:39.972 SYMLINK libspdk_scheduler_gscheduler.so 00:01:39.972 SYMLINK libspdk_keyring_file.so 00:01:39.972 SYMLINK libspdk_accel_error.so 00:01:40.234 SO libspdk_accel_iaa.so.3.0 00:01:40.234 LIB libspdk_blob_bdev.a 00:01:40.234 SO libspdk_accel_dsa.so.5.0 00:01:40.234 SYMLINK libspdk_accel_ioat.so 00:01:40.234 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:40.234 SO libspdk_blob_bdev.so.11.0 00:01:40.234 SYMLINK libspdk_scheduler_dynamic.so 00:01:40.234 SYMLINK libspdk_accel_iaa.so 00:01:40.234 SYMLINK libspdk_accel_dsa.so 00:01:40.234 SYMLINK libspdk_blob_bdev.so 00:01:40.495 LIB libspdk_sock_posix.a 00:01:40.496 SO libspdk_sock_posix.so.6.0 00:01:40.496 SYMLINK libspdk_sock_posix.so 00:01:40.755 CC module/bdev/error/vbdev_error.o 00:01:40.755 CC module/bdev/error/vbdev_error_rpc.o 00:01:40.755 CC module/bdev/lvol/vbdev_lvol.o 00:01:40.755 CC module/bdev/gpt/vbdev_gpt.o 00:01:40.755 CC module/bdev/gpt/gpt.o 00:01:40.755 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:40.755 CC module/bdev/iscsi/bdev_iscsi.o 00:01:40.755 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:40.755 CC module/blobfs/bdev/blobfs_bdev.o 00:01:40.755 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:40.755 CC module/bdev/aio/bdev_aio.o 00:01:40.755 CC module/bdev/aio/bdev_aio_rpc.o 00:01:40.755 CC module/bdev/delay/vbdev_delay.o 00:01:40.755 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:40.755 CC module/bdev/nvme/bdev_nvme.o 00:01:40.755 CC module/bdev/raid/bdev_raid.o 00:01:40.755 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:40.755 CC module/bdev/raid/bdev_raid_rpc.o 00:01:40.755 CC module/bdev/split/vbdev_split.o 00:01:40.755 CC module/bdev/split/vbdev_split_rpc.o 00:01:40.755 CC module/bdev/raid/bdev_raid_sb.o 00:01:40.755 CC module/bdev/nvme/nvme_rpc.o 00:01:40.755 CC module/bdev/raid/raid0.o 00:01:40.755 CC module/bdev/raid/raid1.o 00:01:40.755 CC module/bdev/raid/concat.o 00:01:40.755 CC module/bdev/nvme/bdev_mdns_client.o 00:01:40.755 CC module/bdev/nvme/vbdev_opal.o 00:01:40.755 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:40.755 CC module/bdev/null/bdev_null.o 00:01:40.755 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:40.755 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:40.755 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:40.755 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:40.755 CC module/bdev/null/bdev_null_rpc.o 00:01:40.755 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:40.755 CC module/bdev/malloc/bdev_malloc.o 00:01:40.755 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:40.755 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:40.755 CC module/bdev/ftl/bdev_ftl.o 00:01:40.755 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:40.755 CC module/bdev/passthru/vbdev_passthru.o 00:01:40.755 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:41.014 LIB libspdk_blobfs_bdev.a 00:01:41.014 SO libspdk_blobfs_bdev.so.6.0 00:01:41.014 LIB libspdk_bdev_error.a 00:01:41.014 LIB libspdk_bdev_gpt.a 00:01:41.014 SO libspdk_bdev_error.so.6.0 00:01:41.014 LIB libspdk_bdev_split.a 00:01:41.014 SYMLINK libspdk_blobfs_bdev.so 00:01:41.014 LIB libspdk_bdev_null.a 00:01:41.014 SO libspdk_bdev_gpt.so.6.0 00:01:41.014 SO libspdk_bdev_split.so.6.0 00:01:41.014 LIB libspdk_bdev_ftl.a 00:01:41.014 LIB libspdk_bdev_aio.a 00:01:41.014 SYMLINK libspdk_bdev_error.so 00:01:41.014 LIB libspdk_bdev_passthru.a 00:01:41.014 SO libspdk_bdev_null.so.6.0 00:01:41.014 LIB libspdk_bdev_zone_block.a 00:01:41.014 SO libspdk_bdev_aio.so.6.0 00:01:41.014 LIB libspdk_bdev_delay.a 00:01:41.014 SO libspdk_bdev_ftl.so.6.0 00:01:41.014 LIB libspdk_bdev_iscsi.a 00:01:41.014 LIB libspdk_bdev_malloc.a 00:01:41.014 SYMLINK libspdk_bdev_gpt.so 00:01:41.014 SO libspdk_bdev_passthru.so.6.0 00:01:41.014 SYMLINK libspdk_bdev_split.so 00:01:41.275 SO libspdk_bdev_delay.so.6.0 00:01:41.275 SO libspdk_bdev_malloc.so.6.0 00:01:41.275 SO libspdk_bdev_zone_block.so.6.0 00:01:41.275 SO libspdk_bdev_iscsi.so.6.0 00:01:41.275 SYMLINK libspdk_bdev_ftl.so 00:01:41.275 SYMLINK libspdk_bdev_null.so 00:01:41.275 SYMLINK libspdk_bdev_aio.so 00:01:41.275 SYMLINK libspdk_bdev_passthru.so 00:01:41.275 SYMLINK libspdk_bdev_delay.so 00:01:41.275 LIB libspdk_bdev_lvol.a 00:01:41.275 SYMLINK libspdk_bdev_malloc.so 00:01:41.275 SYMLINK libspdk_bdev_iscsi.so 00:01:41.275 SYMLINK libspdk_bdev_zone_block.so 00:01:41.275 SO libspdk_bdev_lvol.so.6.0 00:01:41.275 LIB libspdk_bdev_virtio.a 00:01:41.275 SO libspdk_bdev_virtio.so.6.0 00:01:41.275 SYMLINK libspdk_bdev_lvol.so 00:01:41.275 SYMLINK libspdk_bdev_virtio.so 00:01:41.536 LIB libspdk_bdev_raid.a 00:01:41.536 SO libspdk_bdev_raid.so.6.0 00:01:41.798 SYMLINK libspdk_bdev_raid.so 00:01:42.741 LIB libspdk_bdev_nvme.a 00:01:42.741 SO libspdk_bdev_nvme.so.7.0 00:01:42.741 SYMLINK libspdk_bdev_nvme.so 00:01:43.685 CC module/event/subsystems/iobuf/iobuf.o 00:01:43.685 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:43.685 CC module/event/subsystems/vmd/vmd.o 00:01:43.685 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:43.685 CC module/event/subsystems/keyring/keyring.o 00:01:43.685 CC module/event/subsystems/sock/sock.o 00:01:43.685 CC module/event/subsystems/scheduler/scheduler.o 00:01:43.685 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:43.685 LIB libspdk_event_keyring.a 00:01:43.685 SO libspdk_event_keyring.so.1.0 00:01:43.685 LIB libspdk_event_scheduler.a 00:01:43.685 LIB libspdk_event_vhost_blk.a 00:01:43.685 LIB libspdk_event_iobuf.a 00:01:43.685 LIB libspdk_event_vmd.a 00:01:43.685 LIB libspdk_event_sock.a 00:01:43.685 SO libspdk_event_scheduler.so.4.0 00:01:43.685 SO libspdk_event_iobuf.so.3.0 00:01:43.685 SO libspdk_event_vhost_blk.so.3.0 00:01:43.685 SO libspdk_event_sock.so.5.0 00:01:43.685 SO libspdk_event_vmd.so.6.0 00:01:43.685 SYMLINK libspdk_event_keyring.so 00:01:43.685 SYMLINK libspdk_event_vhost_blk.so 00:01:43.685 SYMLINK libspdk_event_sock.so 00:01:43.685 SYMLINK libspdk_event_scheduler.so 00:01:43.685 SYMLINK libspdk_event_iobuf.so 00:01:43.685 SYMLINK libspdk_event_vmd.so 00:01:44.257 CC module/event/subsystems/accel/accel.o 00:01:44.257 LIB libspdk_event_accel.a 00:01:44.257 SO libspdk_event_accel.so.6.0 00:01:44.257 SYMLINK libspdk_event_accel.so 00:01:44.830 CC module/event/subsystems/bdev/bdev.o 00:01:44.830 LIB libspdk_event_bdev.a 00:01:44.830 SO libspdk_event_bdev.so.6.0 00:01:45.091 SYMLINK libspdk_event_bdev.so 00:01:45.352 CC module/event/subsystems/scsi/scsi.o 00:01:45.352 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:45.352 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:45.352 CC module/event/subsystems/ublk/ublk.o 00:01:45.352 CC module/event/subsystems/nbd/nbd.o 00:01:45.352 LIB libspdk_event_scsi.a 00:01:45.613 SO libspdk_event_scsi.so.6.0 00:01:45.613 LIB libspdk_event_nbd.a 00:01:45.613 LIB libspdk_event_ublk.a 00:01:45.613 SO libspdk_event_ublk.so.3.0 00:01:45.613 SO libspdk_event_nbd.so.6.0 00:01:45.613 SYMLINK libspdk_event_scsi.so 00:01:45.613 LIB libspdk_event_nvmf.a 00:01:45.613 SO libspdk_event_nvmf.so.6.0 00:01:45.613 SYMLINK libspdk_event_ublk.so 00:01:45.613 SYMLINK libspdk_event_nbd.so 00:01:45.613 SYMLINK libspdk_event_nvmf.so 00:01:45.875 CC module/event/subsystems/iscsi/iscsi.o 00:01:45.875 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:46.136 LIB libspdk_event_vhost_scsi.a 00:01:46.136 LIB libspdk_event_iscsi.a 00:01:46.136 SO libspdk_event_vhost_scsi.so.3.0 00:01:46.136 SO libspdk_event_iscsi.so.6.0 00:01:46.136 SYMLINK libspdk_event_vhost_scsi.so 00:01:46.136 SYMLINK libspdk_event_iscsi.so 00:01:46.397 SO libspdk.so.6.0 00:01:46.397 SYMLINK libspdk.so 00:01:46.660 CC app/trace_record/trace_record.o 00:01:46.660 CXX app/trace/trace.o 00:01:46.660 CC app/spdk_lspci/spdk_lspci.o 00:01:46.660 CC app/spdk_top/spdk_top.o 00:01:46.660 CC app/spdk_nvme_discover/discovery_aer.o 00:01:46.660 CC test/rpc_client/rpc_client_test.o 00:01:46.660 TEST_HEADER include/spdk/accel.h 00:01:46.660 TEST_HEADER include/spdk/accel_module.h 00:01:46.932 TEST_HEADER include/spdk/assert.h 00:01:46.932 TEST_HEADER include/spdk/barrier.h 00:01:46.932 TEST_HEADER include/spdk/base64.h 00:01:46.932 CC app/spdk_nvme_perf/perf.o 00:01:46.932 TEST_HEADER include/spdk/bdev.h 00:01:46.932 CC app/spdk_nvme_identify/identify.o 00:01:46.932 TEST_HEADER include/spdk/bit_array.h 00:01:46.932 TEST_HEADER include/spdk/bdev_module.h 00:01:46.932 TEST_HEADER include/spdk/bdev_zone.h 00:01:46.932 TEST_HEADER include/spdk/bit_pool.h 00:01:46.932 TEST_HEADER include/spdk/blob_bdev.h 00:01:46.932 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:46.932 TEST_HEADER include/spdk/blobfs.h 00:01:46.932 TEST_HEADER include/spdk/blob.h 00:01:46.932 TEST_HEADER include/spdk/conf.h 00:01:46.932 TEST_HEADER include/spdk/config.h 00:01:46.932 TEST_HEADER include/spdk/cpuset.h 00:01:46.932 TEST_HEADER include/spdk/crc16.h 00:01:46.932 TEST_HEADER include/spdk/crc32.h 00:01:46.932 CC app/spdk_dd/spdk_dd.o 00:01:46.932 CC app/nvmf_tgt/nvmf_main.o 00:01:46.932 TEST_HEADER include/spdk/dma.h 00:01:46.932 TEST_HEADER include/spdk/crc64.h 00:01:46.932 TEST_HEADER include/spdk/dif.h 00:01:46.932 TEST_HEADER include/spdk/endian.h 00:01:46.932 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:46.932 TEST_HEADER include/spdk/env.h 00:01:46.932 TEST_HEADER include/spdk/event.h 00:01:46.932 TEST_HEADER include/spdk/env_dpdk.h 00:01:46.932 TEST_HEADER include/spdk/fd_group.h 00:01:46.932 CC app/iscsi_tgt/iscsi_tgt.o 00:01:46.932 TEST_HEADER include/spdk/fd.h 00:01:46.932 TEST_HEADER include/spdk/file.h 00:01:46.932 TEST_HEADER include/spdk/ftl.h 00:01:46.932 TEST_HEADER include/spdk/gpt_spec.h 00:01:46.932 CC app/vhost/vhost.o 00:01:46.932 TEST_HEADER include/spdk/idxd.h 00:01:46.932 TEST_HEADER include/spdk/hexlify.h 00:01:46.932 TEST_HEADER include/spdk/histogram_data.h 00:01:46.932 TEST_HEADER include/spdk/idxd_spec.h 00:01:46.932 TEST_HEADER include/spdk/init.h 00:01:46.932 TEST_HEADER include/spdk/ioat.h 00:01:46.932 TEST_HEADER include/spdk/ioat_spec.h 00:01:46.932 CC app/spdk_tgt/spdk_tgt.o 00:01:46.932 TEST_HEADER include/spdk/jsonrpc.h 00:01:46.932 TEST_HEADER include/spdk/iscsi_spec.h 00:01:46.932 TEST_HEADER include/spdk/keyring_module.h 00:01:46.932 TEST_HEADER include/spdk/json.h 00:01:46.932 TEST_HEADER include/spdk/keyring.h 00:01:46.932 TEST_HEADER include/spdk/log.h 00:01:46.932 TEST_HEADER include/spdk/likely.h 00:01:46.932 TEST_HEADER include/spdk/lvol.h 00:01:46.932 TEST_HEADER include/spdk/memory.h 00:01:46.932 TEST_HEADER include/spdk/mmio.h 00:01:46.932 TEST_HEADER include/spdk/nbd.h 00:01:46.932 TEST_HEADER include/spdk/notify.h 00:01:46.932 TEST_HEADER include/spdk/nvme.h 00:01:46.932 TEST_HEADER include/spdk/nvme_intel.h 00:01:46.932 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:46.932 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:46.932 TEST_HEADER include/spdk/nvme_spec.h 00:01:46.932 TEST_HEADER include/spdk/nvme_zns.h 00:01:46.932 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:46.932 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:46.932 TEST_HEADER include/spdk/nvmf.h 00:01:46.932 TEST_HEADER include/spdk/nvmf_spec.h 00:01:46.932 TEST_HEADER include/spdk/nvmf_transport.h 00:01:46.932 TEST_HEADER include/spdk/opal_spec.h 00:01:46.932 TEST_HEADER include/spdk/pci_ids.h 00:01:46.932 TEST_HEADER include/spdk/opal.h 00:01:46.932 TEST_HEADER include/spdk/pipe.h 00:01:46.932 TEST_HEADER include/spdk/queue.h 00:01:46.932 TEST_HEADER include/spdk/rpc.h 00:01:46.932 TEST_HEADER include/spdk/reduce.h 00:01:46.932 TEST_HEADER include/spdk/scsi.h 00:01:46.932 TEST_HEADER include/spdk/scheduler.h 00:01:46.932 TEST_HEADER include/spdk/scsi_spec.h 00:01:46.932 TEST_HEADER include/spdk/sock.h 00:01:46.932 TEST_HEADER include/spdk/stdinc.h 00:01:46.932 TEST_HEADER include/spdk/string.h 00:01:46.932 TEST_HEADER include/spdk/trace.h 00:01:46.932 TEST_HEADER include/spdk/thread.h 00:01:46.932 TEST_HEADER include/spdk/trace_parser.h 00:01:46.932 TEST_HEADER include/spdk/tree.h 00:01:46.932 TEST_HEADER include/spdk/ublk.h 00:01:46.932 TEST_HEADER include/spdk/util.h 00:01:46.932 TEST_HEADER include/spdk/uuid.h 00:01:46.932 TEST_HEADER include/spdk/version.h 00:01:46.932 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:46.932 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:46.932 TEST_HEADER include/spdk/vhost.h 00:01:46.932 TEST_HEADER include/spdk/vmd.h 00:01:46.932 TEST_HEADER include/spdk/xor.h 00:01:46.932 TEST_HEADER include/spdk/zipf.h 00:01:46.932 CXX test/cpp_headers/accel.o 00:01:46.932 CXX test/cpp_headers/accel_module.o 00:01:46.932 CXX test/cpp_headers/assert.o 00:01:46.932 CXX test/cpp_headers/barrier.o 00:01:46.932 CXX test/cpp_headers/base64.o 00:01:46.932 CXX test/cpp_headers/bdev.o 00:01:46.932 CXX test/cpp_headers/bdev_zone.o 00:01:46.932 CXX test/cpp_headers/bdev_module.o 00:01:46.932 CXX test/cpp_headers/bit_array.o 00:01:46.932 CXX test/cpp_headers/bit_pool.o 00:01:46.932 CXX test/cpp_headers/blob_bdev.o 00:01:46.932 CXX test/cpp_headers/blobfs_bdev.o 00:01:46.932 CXX test/cpp_headers/blob.o 00:01:46.932 CXX test/cpp_headers/blobfs.o 00:01:46.932 CXX test/cpp_headers/conf.o 00:01:46.932 CXX test/cpp_headers/cpuset.o 00:01:46.932 CXX test/cpp_headers/config.o 00:01:46.932 CXX test/cpp_headers/crc16.o 00:01:46.932 CXX test/cpp_headers/dif.o 00:01:46.932 CXX test/cpp_headers/crc32.o 00:01:46.932 CXX test/cpp_headers/crc64.o 00:01:46.932 CXX test/cpp_headers/dma.o 00:01:46.932 CXX test/cpp_headers/endian.o 00:01:46.932 CXX test/cpp_headers/env_dpdk.o 00:01:46.932 CXX test/cpp_headers/env.o 00:01:46.932 CXX test/cpp_headers/fd_group.o 00:01:46.932 CXX test/cpp_headers/event.o 00:01:46.932 CXX test/cpp_headers/file.o 00:01:46.932 CXX test/cpp_headers/fd.o 00:01:46.932 CXX test/cpp_headers/ftl.o 00:01:46.932 CXX test/cpp_headers/histogram_data.o 00:01:46.932 CXX test/cpp_headers/hexlify.o 00:01:46.932 CXX test/cpp_headers/gpt_spec.o 00:01:46.932 CXX test/cpp_headers/idxd.o 00:01:46.932 CXX test/cpp_headers/idxd_spec.o 00:01:46.932 CXX test/cpp_headers/init.o 00:01:46.932 CXX test/cpp_headers/ioat.o 00:01:46.932 CXX test/cpp_headers/iscsi_spec.o 00:01:46.932 CXX test/cpp_headers/ioat_spec.o 00:01:46.932 CXX test/cpp_headers/json.o 00:01:46.932 CXX test/cpp_headers/jsonrpc.o 00:01:46.932 CXX test/cpp_headers/keyring.o 00:01:46.932 CXX test/cpp_headers/keyring_module.o 00:01:46.932 CXX test/cpp_headers/likely.o 00:01:46.932 CXX test/cpp_headers/log.o 00:01:46.932 CXX test/cpp_headers/lvol.o 00:01:46.932 CXX test/cpp_headers/mmio.o 00:01:46.932 CXX test/cpp_headers/memory.o 00:01:46.932 CXX test/cpp_headers/notify.o 00:01:46.932 CXX test/cpp_headers/nbd.o 00:01:46.932 CXX test/cpp_headers/nvme.o 00:01:46.932 CXX test/cpp_headers/nvme_intel.o 00:01:46.932 CXX test/cpp_headers/nvme_ocssd.o 00:01:46.932 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:46.932 CXX test/cpp_headers/nvme_spec.o 00:01:46.932 CXX test/cpp_headers/nvme_zns.o 00:01:46.932 CXX test/cpp_headers/nvmf_cmd.o 00:01:46.932 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:46.932 CXX test/cpp_headers/nvmf_spec.o 00:01:46.932 CXX test/cpp_headers/nvmf.o 00:01:46.932 CXX test/cpp_headers/nvmf_transport.o 00:01:46.932 CXX test/cpp_headers/opal.o 00:01:46.932 CC examples/accel/perf/accel_perf.o 00:01:46.932 CXX test/cpp_headers/opal_spec.o 00:01:46.932 CXX test/cpp_headers/pci_ids.o 00:01:46.932 CXX test/cpp_headers/queue.o 00:01:46.932 CXX test/cpp_headers/pipe.o 00:01:46.932 CXX test/cpp_headers/reduce.o 00:01:46.932 CXX test/cpp_headers/rpc.o 00:01:46.932 CC test/app/stub/stub.o 00:01:46.932 CXX test/cpp_headers/scheduler.o 00:01:46.932 CC test/event/reactor_perf/reactor_perf.o 00:01:46.932 CC examples/util/zipf/zipf.o 00:01:46.932 CC test/env/pci/pci_ut.o 00:01:46.932 CXX test/cpp_headers/scsi.o 00:01:46.932 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:46.932 CC test/app/histogram_perf/histogram_perf.o 00:01:46.932 CC examples/nvme/hello_world/hello_world.o 00:01:46.932 CC test/env/memory/memory_ut.o 00:01:46.932 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:46.932 CC examples/nvme/reconnect/reconnect.o 00:01:46.932 CC test/event/reactor/reactor.o 00:01:46.932 CC test/env/vtophys/vtophys.o 00:01:46.932 CC examples/idxd/perf/perf.o 00:01:46.932 CC examples/vmd/lsvmd/lsvmd.o 00:01:47.202 CC app/fio/nvme/fio_plugin.o 00:01:47.202 CC test/nvme/overhead/overhead.o 00:01:47.202 CC examples/nvme/arbitration/arbitration.o 00:01:47.202 CC examples/ioat/perf/perf.o 00:01:47.202 CC test/app/jsoncat/jsoncat.o 00:01:47.202 CC test/nvme/aer/aer.o 00:01:47.202 CC test/nvme/reset/reset.o 00:01:47.202 CC examples/nvme/hotplug/hotplug.o 00:01:47.202 CC test/nvme/fdp/fdp.o 00:01:47.202 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:47.202 CC examples/vmd/led/led.o 00:01:47.202 CC test/nvme/simple_copy/simple_copy.o 00:01:47.202 CC test/event/app_repeat/app_repeat.o 00:01:47.202 CC test/event/event_perf/event_perf.o 00:01:47.202 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:47.202 CC test/nvme/startup/startup.o 00:01:47.202 CC test/nvme/err_injection/err_injection.o 00:01:47.202 CC test/nvme/fused_ordering/fused_ordering.o 00:01:47.202 CC examples/ioat/verify/verify.o 00:01:47.202 CC test/nvme/e2edp/nvme_dp.o 00:01:47.202 CC test/nvme/connect_stress/connect_stress.o 00:01:47.202 CC examples/nvme/abort/abort.o 00:01:47.202 CC test/nvme/reserve/reserve.o 00:01:47.202 CC test/nvme/boot_partition/boot_partition.o 00:01:47.202 CC test/nvme/compliance/nvme_compliance.o 00:01:47.202 CC test/nvme/sgl/sgl.o 00:01:47.202 CC examples/blob/cli/blobcli.o 00:01:47.202 CC examples/sock/hello_world/hello_sock.o 00:01:47.202 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:47.202 CC test/app/bdev_svc/bdev_svc.o 00:01:47.202 CC examples/blob/hello_world/hello_blob.o 00:01:47.202 CC test/thread/poller_perf/poller_perf.o 00:01:47.202 CC test/event/scheduler/scheduler.o 00:01:47.202 CC test/blobfs/mkfs/mkfs.o 00:01:47.202 CC app/fio/bdev/fio_plugin.o 00:01:47.202 CC test/bdev/bdevio/bdevio.o 00:01:47.202 LINK spdk_lspci 00:01:47.202 CC test/nvme/cuse/cuse.o 00:01:47.202 CC examples/thread/thread/thread_ex.o 00:01:47.202 CC test/accel/dif/dif.o 00:01:47.202 CC test/dma/test_dma/test_dma.o 00:01:47.202 CC examples/nvmf/nvmf/nvmf.o 00:01:47.202 CC examples/bdev/bdevperf/bdevperf.o 00:01:47.202 CC examples/bdev/hello_world/hello_bdev.o 00:01:47.476 LINK rpc_client_test 00:01:47.476 LINK spdk_nvme_discover 00:01:47.476 LINK interrupt_tgt 00:01:47.476 CC test/env/mem_callbacks/mem_callbacks.o 00:01:47.476 LINK nvmf_tgt 00:01:47.476 CC test/lvol/esnap/esnap.o 00:01:47.476 LINK vhost 00:01:47.476 LINK spdk_trace_record 00:01:47.476 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:47.476 LINK iscsi_tgt 00:01:47.741 LINK spdk_tgt 00:01:47.741 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:47.741 LINK reactor 00:01:47.741 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:47.741 LINK reactor_perf 00:01:47.741 LINK lsvmd 00:01:47.741 LINK histogram_perf 00:01:47.741 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:47.741 LINK vtophys 00:01:47.741 LINK startup 00:01:47.741 LINK env_dpdk_post_init 00:01:47.741 LINK app_repeat 00:01:47.741 LINK led 00:01:47.741 LINK jsoncat 00:01:47.741 LINK boot_partition 00:01:47.741 LINK zipf 00:01:47.741 LINK stub 00:01:47.741 LINK err_injection 00:01:47.741 LINK event_perf 00:01:47.741 LINK verify 00:01:47.741 LINK connect_stress 00:01:47.741 CXX test/cpp_headers/scsi_spec.o 00:01:47.741 LINK poller_perf 00:01:47.741 LINK pmr_persistence 00:01:47.741 CXX test/cpp_headers/stdinc.o 00:01:47.741 CXX test/cpp_headers/sock.o 00:01:47.741 LINK doorbell_aers 00:01:47.741 CXX test/cpp_headers/string.o 00:01:47.741 LINK hello_world 00:01:47.741 CXX test/cpp_headers/thread.o 00:01:47.741 LINK fused_ordering 00:01:47.741 CXX test/cpp_headers/trace.o 00:01:47.741 CXX test/cpp_headers/trace_parser.o 00:01:47.741 CXX test/cpp_headers/tree.o 00:01:47.741 CXX test/cpp_headers/ublk.o 00:01:47.741 CXX test/cpp_headers/uuid.o 00:01:47.741 CXX test/cpp_headers/util.o 00:01:47.741 CXX test/cpp_headers/version.o 00:01:47.741 CXX test/cpp_headers/vfio_user_pci.o 00:01:48.000 CXX test/cpp_headers/vfio_user_spec.o 00:01:48.001 CXX test/cpp_headers/vhost.o 00:01:48.001 CXX test/cpp_headers/vmd.o 00:01:48.001 CXX test/cpp_headers/xor.o 00:01:48.001 LINK reserve 00:01:48.001 CXX test/cpp_headers/zipf.o 00:01:48.001 LINK cmb_copy 00:01:48.001 LINK simple_copy 00:01:48.001 LINK mkfs 00:01:48.001 LINK ioat_perf 00:01:48.001 LINK bdev_svc 00:01:48.001 LINK aer 00:01:48.001 LINK scheduler 00:01:48.001 LINK hello_sock 00:01:48.001 LINK sgl 00:01:48.001 LINK spdk_dd 00:01:48.001 LINK hello_blob 00:01:48.001 LINK hotplug 00:01:48.001 LINK thread 00:01:48.001 LINK overhead 00:01:48.001 LINK fdp 00:01:48.001 LINK idxd_perf 00:01:48.001 LINK hello_bdev 00:01:48.001 LINK reconnect 00:01:48.001 LINK reset 00:01:48.001 LINK nvmf 00:01:48.001 LINK arbitration 00:01:48.001 LINK nvme_dp 00:01:48.001 LINK pci_ut 00:01:48.001 LINK spdk_trace 00:01:48.001 LINK nvme_compliance 00:01:48.001 LINK abort 00:01:48.001 LINK bdevio 00:01:48.261 LINK dif 00:01:48.261 LINK test_dma 00:01:48.261 LINK accel_perf 00:01:48.261 LINK mem_callbacks 00:01:48.261 LINK nvme_manage 00:01:48.261 LINK spdk_nvme 00:01:48.261 LINK blobcli 00:01:48.261 LINK nvme_fuzz 00:01:48.261 LINK spdk_bdev 00:01:48.261 LINK spdk_nvme_perf 00:01:48.261 LINK vhost_fuzz 00:01:48.261 LINK spdk_nvme_identify 00:01:48.522 LINK spdk_top 00:01:48.522 LINK memory_ut 00:01:48.522 LINK bdevperf 00:01:48.522 LINK cuse 00:01:49.467 LINK iscsi_fuzz 00:01:51.381 LINK esnap 00:01:51.381 00:01:51.381 real 0m48.264s 00:01:51.381 user 6m22.488s 00:01:51.381 sys 4m44.494s 00:01:51.381 14:49:32 -- common/autotest_common.sh@1122 -- $ xtrace_disable 00:01:51.381 14:49:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:51.381 ************************************ 00:01:51.381 END TEST make 00:01:51.381 ************************************ 00:01:51.643 14:49:32 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:01:51.643 14:49:32 -- pm/common@30 -- $ signal_monitor_resources TERM 00:01:51.643 14:49:32 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:01:51.643 14:49:32 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.643 14:49:32 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:01:51.643 14:49:32 -- pm/common@45 -- $ pid=3186074 00:01:51.643 14:49:32 -- pm/common@52 -- $ sudo kill -TERM 3186074 00:01:51.643 14:49:32 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.643 14:49:32 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:01:51.643 14:49:32 -- pm/common@45 -- $ pid=3186085 00:01:51.643 14:49:32 -- pm/common@52 -- $ sudo kill -TERM 3186085 00:01:51.643 14:49:32 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.643 14:49:32 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:01:51.643 14:49:32 -- pm/common@45 -- $ pid=3186086 00:01:51.643 14:49:32 -- pm/common@52 -- $ sudo kill -TERM 3186086 00:01:51.643 14:49:32 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.643 14:49:32 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:01:51.643 14:49:32 -- pm/common@45 -- $ pid=3186075 00:01:51.643 14:49:32 -- pm/common@52 -- $ sudo kill -TERM 3186075 00:01:51.904 14:49:32 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:01:51.904 14:49:32 -- nvmf/common.sh@7 -- # uname -s 00:01:51.904 14:49:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:51.904 14:49:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:51.904 14:49:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:51.904 14:49:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:51.904 14:49:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:51.904 14:49:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:51.904 14:49:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:51.904 14:49:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:51.904 14:49:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:51.904 14:49:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:51.904 14:49:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:01:51.904 14:49:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:01:51.904 14:49:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:51.904 14:49:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:51.904 14:49:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:51.904 14:49:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:01:51.904 14:49:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:01:51.904 14:49:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:51.904 14:49:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:51.904 14:49:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:51.904 14:49:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:51.904 14:49:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:51.904 14:49:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:51.904 14:49:32 -- paths/export.sh@5 -- # export PATH 00:01:51.904 14:49:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:51.904 14:49:32 -- nvmf/common.sh@47 -- # : 0 00:01:51.904 14:49:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:01:51.904 14:49:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:01:51.904 14:49:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:01:51.904 14:49:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:51.904 14:49:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:51.904 14:49:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:01:51.904 14:49:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:01:51.904 14:49:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:01:51.904 14:49:32 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:51.904 14:49:32 -- spdk/autotest.sh@32 -- # uname -s 00:01:51.905 14:49:32 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:51.905 14:49:32 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:51.905 14:49:32 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:01:51.905 14:49:32 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:51.905 14:49:32 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:01:51.905 14:49:32 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:51.905 14:49:32 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:51.905 14:49:32 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:51.905 14:49:32 -- spdk/autotest.sh@48 -- # udevadm_pid=3247685 00:01:51.905 14:49:32 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:01:51.905 14:49:32 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:51.905 14:49:32 -- pm/common@17 -- # local monitor 00:01:51.905 14:49:32 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.905 14:49:32 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3247687 00:01:51.905 14:49:32 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.905 14:49:32 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3247691 00:01:51.905 14:49:32 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.905 14:49:32 -- pm/common@21 -- # date +%s 00:01:51.905 14:49:32 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3247695 00:01:51.905 14:49:32 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:51.905 14:49:32 -- pm/common@21 -- # date +%s 00:01:51.905 14:49:32 -- pm/common@21 -- # date +%s 00:01:51.905 14:49:32 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3247698 00:01:51.905 14:49:32 -- pm/common@26 -- # sleep 1 00:01:51.905 14:49:32 -- pm/common@21 -- # date +%s 00:01:51.905 14:49:32 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714135772 00:01:51.905 14:49:32 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714135772 00:01:51.905 14:49:32 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714135772 00:01:51.905 14:49:32 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714135772 00:01:51.905 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714135772_collect-vmstat.pm.log 00:01:51.905 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714135772_collect-cpu-load.pm.log 00:01:51.905 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714135772_collect-bmc-pm.bmc.pm.log 00:01:51.905 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714135772_collect-cpu-temp.pm.log 00:01:53.000 14:49:33 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:53.000 14:49:33 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:01:53.000 14:49:33 -- common/autotest_common.sh@720 -- # xtrace_disable 00:01:53.000 14:49:33 -- common/autotest_common.sh@10 -- # set +x 00:01:53.000 14:49:33 -- spdk/autotest.sh@59 -- # create_test_list 00:01:53.000 14:49:33 -- common/autotest_common.sh@744 -- # xtrace_disable 00:01:53.000 14:49:33 -- common/autotest_common.sh@10 -- # set +x 00:01:53.001 14:49:33 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:01:53.001 14:49:33 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.001 14:49:33 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.001 14:49:33 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:01:53.001 14:49:33 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.001 14:49:33 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:01:53.001 14:49:33 -- common/autotest_common.sh@1451 -- # uname 00:01:53.001 14:49:33 -- common/autotest_common.sh@1451 -- # '[' Linux = FreeBSD ']' 00:01:53.001 14:49:33 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:01:53.001 14:49:33 -- common/autotest_common.sh@1471 -- # uname 00:01:53.001 14:49:33 -- common/autotest_common.sh@1471 -- # [[ Linux = FreeBSD ]] 00:01:53.001 14:49:33 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:01:53.001 14:49:33 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:01:53.001 14:49:33 -- spdk/autotest.sh@72 -- # hash lcov 00:01:53.001 14:49:33 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:01:53.001 14:49:33 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:01:53.001 --rc lcov_branch_coverage=1 00:01:53.001 --rc lcov_function_coverage=1 00:01:53.001 --rc genhtml_branch_coverage=1 00:01:53.001 --rc genhtml_function_coverage=1 00:01:53.001 --rc genhtml_legend=1 00:01:53.001 --rc geninfo_all_blocks=1 00:01:53.001 ' 00:01:53.001 14:49:33 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:01:53.001 --rc lcov_branch_coverage=1 00:01:53.001 --rc lcov_function_coverage=1 00:01:53.001 --rc genhtml_branch_coverage=1 00:01:53.001 --rc genhtml_function_coverage=1 00:01:53.001 --rc genhtml_legend=1 00:01:53.001 --rc geninfo_all_blocks=1 00:01:53.001 ' 00:01:53.001 14:49:33 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:01:53.001 --rc lcov_branch_coverage=1 00:01:53.001 --rc lcov_function_coverage=1 00:01:53.001 --rc genhtml_branch_coverage=1 00:01:53.001 --rc genhtml_function_coverage=1 00:01:53.001 --rc genhtml_legend=1 00:01:53.001 --rc geninfo_all_blocks=1 00:01:53.001 --no-external' 00:01:53.001 14:49:33 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:01:53.001 --rc lcov_branch_coverage=1 00:01:53.001 --rc lcov_function_coverage=1 00:01:53.001 --rc genhtml_branch_coverage=1 00:01:53.001 --rc genhtml_function_coverage=1 00:01:53.001 --rc genhtml_legend=1 00:01:53.001 --rc geninfo_all_blocks=1 00:01:53.001 --no-external' 00:01:53.001 14:49:33 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:01:53.001 lcov: LCOV version 1.14 00:01:53.001 14:49:33 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:01.155 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:01.155 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:01.156 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:01.156 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:01.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:01.157 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:04.458 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:04.458 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:14.464 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:14.464 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:14.464 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:14.464 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:14.464 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:14.464 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:21.052 14:50:01 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:21.052 14:50:01 -- common/autotest_common.sh@720 -- # xtrace_disable 00:02:21.052 14:50:01 -- common/autotest_common.sh@10 -- # set +x 00:02:21.052 14:50:01 -- spdk/autotest.sh@91 -- # rm -f 00:02:21.052 14:50:01 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:23.597 0000:80:01.6 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.7 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.4 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.5 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.2 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.3 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.0 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:80:01.1 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:65:00.0 (144d a80a): Already using the nvme driver 00:02:23.597 0000:00:01.6 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.7 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.4 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.5 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.2 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.3 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.0 (8086 0b00): Already using the ioatdma driver 00:02:23.597 0000:00:01.1 (8086 0b00): Already using the ioatdma driver 00:02:23.858 14:50:04 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:23.858 14:50:04 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:02:23.858 14:50:04 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:02:23.858 14:50:04 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:02:23.858 14:50:04 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:02:23.858 14:50:04 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:02:23.858 14:50:04 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:02:23.858 14:50:04 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:23.858 14:50:04 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:02:23.858 14:50:04 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:02:23.858 14:50:04 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:23.858 14:50:04 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:23.858 14:50:04 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:23.858 14:50:04 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:23.858 14:50:04 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:23.858 No valid GPT data, bailing 00:02:23.858 14:50:04 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:23.858 14:50:04 -- scripts/common.sh@391 -- # pt= 00:02:23.858 14:50:04 -- scripts/common.sh@392 -- # return 1 00:02:23.858 14:50:04 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:23.858 1+0 records in 00:02:23.858 1+0 records out 00:02:23.858 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00140961 s, 744 MB/s 00:02:23.858 14:50:04 -- spdk/autotest.sh@118 -- # sync 00:02:23.858 14:50:04 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:23.858 14:50:04 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:23.858 14:50:04 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:32.001 14:50:11 -- spdk/autotest.sh@124 -- # uname -s 00:02:32.001 14:50:11 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:02:32.001 14:50:11 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:32.001 14:50:11 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:32.001 14:50:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:32.001 14:50:11 -- common/autotest_common.sh@10 -- # set +x 00:02:32.001 ************************************ 00:02:32.001 START TEST setup.sh 00:02:32.001 ************************************ 00:02:32.001 14:50:11 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:32.001 * Looking for test storage... 00:02:32.001 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:32.001 14:50:11 -- setup/test-setup.sh@10 -- # uname -s 00:02:32.001 14:50:11 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:32.001 14:50:11 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:32.001 14:50:11 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:32.001 14:50:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:32.001 14:50:11 -- common/autotest_common.sh@10 -- # set +x 00:02:32.001 ************************************ 00:02:32.001 START TEST acl 00:02:32.001 ************************************ 00:02:32.001 14:50:12 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:32.001 * Looking for test storage... 00:02:32.001 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:32.001 14:50:12 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:32.001 14:50:12 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:02:32.001 14:50:12 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:02:32.001 14:50:12 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:02:32.001 14:50:12 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:02:32.001 14:50:12 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:02:32.001 14:50:12 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:02:32.001 14:50:12 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:32.001 14:50:12 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:02:32.001 14:50:12 -- setup/acl.sh@12 -- # devs=() 00:02:32.001 14:50:12 -- setup/acl.sh@12 -- # declare -a devs 00:02:32.001 14:50:12 -- setup/acl.sh@13 -- # drivers=() 00:02:32.001 14:50:12 -- setup/acl.sh@13 -- # declare -A drivers 00:02:32.001 14:50:12 -- setup/acl.sh@51 -- # setup reset 00:02:32.001 14:50:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:32.001 14:50:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:35.318 14:50:15 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:35.318 14:50:15 -- setup/acl.sh@16 -- # local dev driver 00:02:35.318 14:50:15 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:35.318 14:50:15 -- setup/acl.sh@15 -- # setup output status 00:02:35.318 14:50:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:35.318 14:50:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:02:38.616 Hugepages 00:02:38.616 node hugesize free / total 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # continue 00:02:38.616 14:50:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # continue 00:02:38.616 14:50:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # continue 00:02:38.616 14:50:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 00:02:38.616 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:38.616 14:50:18 -- setup/acl.sh@19 -- # continue 00:02:38.616 14:50:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.0 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.1 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.2 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.3 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.4 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.5 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.6 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.616 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:00:01.7 == *:*:*.* ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.616 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.616 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:65:00.0 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:38.617 14:50:19 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.0 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.1 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.2 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.3 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.4 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.5 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.6 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@19 -- # [[ 0000:80:01.7 == *:*:*.* ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:38.617 14:50:19 -- setup/acl.sh@20 -- # continue 00:02:38.617 14:50:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:38.617 14:50:19 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:38.617 14:50:19 -- setup/acl.sh@54 -- # run_test denied denied 00:02:38.617 14:50:19 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:38.617 14:50:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:38.617 14:50:19 -- common/autotest_common.sh@10 -- # set +x 00:02:38.617 ************************************ 00:02:38.617 START TEST denied 00:02:38.617 ************************************ 00:02:38.617 14:50:19 -- common/autotest_common.sh@1121 -- # denied 00:02:38.617 14:50:19 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:65:00.0' 00:02:38.617 14:50:19 -- setup/acl.sh@38 -- # setup output config 00:02:38.617 14:50:19 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:65:00.0' 00:02:38.617 14:50:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:38.617 14:50:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:41.922 0000:65:00.0 (144d a80a): Skipping denied controller at 0000:65:00.0 00:02:41.922 14:50:22 -- setup/acl.sh@40 -- # verify 0000:65:00.0 00:02:41.922 14:50:22 -- setup/acl.sh@28 -- # local dev driver 00:02:41.922 14:50:22 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:41.922 14:50:22 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:65:00.0 ]] 00:02:41.922 14:50:22 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:65:00.0/driver 00:02:41.922 14:50:22 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:41.922 14:50:22 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:41.922 14:50:22 -- setup/acl.sh@41 -- # setup reset 00:02:41.922 14:50:22 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:41.922 14:50:22 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:47.217 00:02:47.217 real 0m7.998s 00:02:47.217 user 0m2.650s 00:02:47.217 sys 0m4.687s 00:02:47.217 14:50:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:02:47.217 14:50:27 -- common/autotest_common.sh@10 -- # set +x 00:02:47.217 ************************************ 00:02:47.217 END TEST denied 00:02:47.217 ************************************ 00:02:47.217 14:50:27 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:47.217 14:50:27 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:47.217 14:50:27 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:47.217 14:50:27 -- common/autotest_common.sh@10 -- # set +x 00:02:47.217 ************************************ 00:02:47.217 START TEST allowed 00:02:47.217 ************************************ 00:02:47.217 14:50:27 -- common/autotest_common.sh@1121 -- # allowed 00:02:47.217 14:50:27 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:65:00.0 00:02:47.217 14:50:27 -- setup/acl.sh@45 -- # setup output config 00:02:47.217 14:50:27 -- setup/acl.sh@46 -- # grep -E '0000:65:00.0 .*: nvme -> .*' 00:02:47.217 14:50:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:47.217 14:50:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:52.514 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:02:52.514 14:50:32 -- setup/acl.sh@47 -- # verify 00:02:52.514 14:50:32 -- setup/acl.sh@28 -- # local dev driver 00:02:52.514 14:50:32 -- setup/acl.sh@48 -- # setup reset 00:02:52.514 14:50:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:52.514 14:50:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:55.820 00:02:55.820 real 0m8.908s 00:02:55.820 user 0m2.624s 00:02:55.820 sys 0m4.592s 00:02:55.820 14:50:36 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:02:55.820 14:50:36 -- common/autotest_common.sh@10 -- # set +x 00:02:55.820 ************************************ 00:02:55.820 END TEST allowed 00:02:55.820 ************************************ 00:02:55.820 00:02:55.820 real 0m24.403s 00:02:55.820 user 0m8.012s 00:02:55.820 sys 0m14.186s 00:02:55.820 14:50:36 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:02:55.820 14:50:36 -- common/autotest_common.sh@10 -- # set +x 00:02:55.820 ************************************ 00:02:55.820 END TEST acl 00:02:55.820 ************************************ 00:02:55.820 14:50:36 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:02:55.820 14:50:36 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:55.820 14:50:36 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:55.820 14:50:36 -- common/autotest_common.sh@10 -- # set +x 00:02:55.820 ************************************ 00:02:55.820 START TEST hugepages 00:02:55.820 ************************************ 00:02:55.820 14:50:36 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:02:55.820 * Looking for test storage... 00:02:55.820 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:55.820 14:50:36 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:55.820 14:50:36 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:55.820 14:50:36 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:55.820 14:50:36 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:55.820 14:50:36 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:55.820 14:50:36 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:55.820 14:50:36 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:55.820 14:50:36 -- setup/common.sh@18 -- # local node= 00:02:55.820 14:50:36 -- setup/common.sh@19 -- # local var val 00:02:55.820 14:50:36 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.820 14:50:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.820 14:50:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.820 14:50:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.820 14:50:36 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.820 14:50:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.820 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.820 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 98852796 kB' 'MemAvailable: 103155036 kB' 'Buffers: 2696 kB' 'Cached: 18130428 kB' 'SwapCached: 0 kB' 'Active: 15062236 kB' 'Inactive: 3667940 kB' 'Active(anon): 13938292 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 601128 kB' 'Mapped: 204640 kB' 'Shmem: 13341240 kB' 'KReclaimable: 551300 kB' 'Slab: 1424228 kB' 'SReclaimable: 551300 kB' 'SUnreclaim: 872928 kB' 'KernelStack: 27664 kB' 'PageTables: 9824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69460904 kB' 'Committed_AS: 15451328 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236184 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:55.821 14:50:36 -- setup/common.sh@32 -- # continue 00:02:55.821 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.082 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.082 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.082 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.082 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.082 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.082 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # continue 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.083 14:50:36 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.083 14:50:36 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:56.083 14:50:36 -- setup/common.sh@33 -- # echo 2048 00:02:56.083 14:50:36 -- setup/common.sh@33 -- # return 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:56.083 14:50:36 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:56.083 14:50:36 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:56.083 14:50:36 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:56.083 14:50:36 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:56.083 14:50:36 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:56.083 14:50:36 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:56.083 14:50:36 -- setup/hugepages.sh@207 -- # get_nodes 00:02:56.083 14:50:36 -- setup/hugepages.sh@27 -- # local node 00:02:56.083 14:50:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:56.083 14:50:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:56.083 14:50:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:56.083 14:50:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:56.083 14:50:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:56.083 14:50:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:56.083 14:50:36 -- setup/hugepages.sh@208 -- # clear_hp 00:02:56.083 14:50:36 -- setup/hugepages.sh@37 -- # local node hp 00:02:56.083 14:50:36 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:56.083 14:50:36 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:56.083 14:50:36 -- setup/hugepages.sh@41 -- # echo 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:56.083 14:50:36 -- setup/hugepages.sh@41 -- # echo 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:56.083 14:50:36 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:56.083 14:50:36 -- setup/hugepages.sh@41 -- # echo 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:56.083 14:50:36 -- setup/hugepages.sh@41 -- # echo 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:56.083 14:50:36 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:56.083 14:50:36 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:56.083 14:50:36 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:56.083 14:50:36 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:56.083 14:50:36 -- common/autotest_common.sh@10 -- # set +x 00:02:56.083 ************************************ 00:02:56.083 START TEST default_setup 00:02:56.083 ************************************ 00:02:56.083 14:50:36 -- common/autotest_common.sh@1121 -- # default_setup 00:02:56.083 14:50:36 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:56.083 14:50:36 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:56.083 14:50:36 -- setup/hugepages.sh@51 -- # shift 00:02:56.083 14:50:36 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:56.083 14:50:36 -- setup/hugepages.sh@52 -- # local node_ids 00:02:56.083 14:50:36 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:56.083 14:50:36 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:56.083 14:50:36 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:56.083 14:50:36 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:56.083 14:50:36 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:56.083 14:50:36 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:56.083 14:50:36 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:56.083 14:50:36 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:56.083 14:50:36 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:56.083 14:50:36 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:56.083 14:50:36 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:56.083 14:50:36 -- setup/hugepages.sh@73 -- # return 0 00:02:56.083 14:50:36 -- setup/hugepages.sh@137 -- # setup output 00:02:56.083 14:50:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:56.083 14:50:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:02:59.384 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:02:59.384 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:02:59.385 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:02:59.647 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:02:59.647 14:50:40 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:59.647 14:50:40 -- setup/hugepages.sh@89 -- # local node 00:02:59.647 14:50:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:59.647 14:50:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:59.647 14:50:40 -- setup/hugepages.sh@92 -- # local surp 00:02:59.647 14:50:40 -- setup/hugepages.sh@93 -- # local resv 00:02:59.647 14:50:40 -- setup/hugepages.sh@94 -- # local anon 00:02:59.647 14:50:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:59.647 14:50:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:59.647 14:50:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:59.647 14:50:40 -- setup/common.sh@18 -- # local node= 00:02:59.647 14:50:40 -- setup/common.sh@19 -- # local var val 00:02:59.647 14:50:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.647 14:50:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.647 14:50:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.647 14:50:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.647 14:50:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.647 14:50:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101013156 kB' 'MemAvailable: 105315364 kB' 'Buffers: 2696 kB' 'Cached: 18130548 kB' 'SwapCached: 0 kB' 'Active: 15081256 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957312 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619588 kB' 'Mapped: 204876 kB' 'Shmem: 13341360 kB' 'KReclaimable: 551268 kB' 'Slab: 1422080 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 870812 kB' 'KernelStack: 27584 kB' 'PageTables: 9768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15472528 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236344 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.647 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.647 14:50:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.648 14:50:40 -- setup/common.sh@33 -- # echo 0 00:02:59.648 14:50:40 -- setup/common.sh@33 -- # return 0 00:02:59.648 14:50:40 -- setup/hugepages.sh@97 -- # anon=0 00:02:59.648 14:50:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:59.648 14:50:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.648 14:50:40 -- setup/common.sh@18 -- # local node= 00:02:59.648 14:50:40 -- setup/common.sh@19 -- # local var val 00:02:59.648 14:50:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.648 14:50:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.648 14:50:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.648 14:50:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.648 14:50:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.648 14:50:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101011896 kB' 'MemAvailable: 105314104 kB' 'Buffers: 2696 kB' 'Cached: 18130552 kB' 'SwapCached: 0 kB' 'Active: 15081456 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957512 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619828 kB' 'Mapped: 204876 kB' 'Shmem: 13341364 kB' 'KReclaimable: 551268 kB' 'Slab: 1422080 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 870812 kB' 'KernelStack: 27584 kB' 'PageTables: 9776 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15472540 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236328 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.648 14:50:40 -- setup/common.sh@33 -- # echo 0 00:02:59.648 14:50:40 -- setup/common.sh@33 -- # return 0 00:02:59.648 14:50:40 -- setup/hugepages.sh@99 -- # surp=0 00:02:59.648 14:50:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:59.648 14:50:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:59.648 14:50:40 -- setup/common.sh@18 -- # local node= 00:02:59.648 14:50:40 -- setup/common.sh@19 -- # local var val 00:02:59.648 14:50:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.648 14:50:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.648 14:50:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.648 14:50:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.648 14:50:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.648 14:50:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101012036 kB' 'MemAvailable: 105314244 kB' 'Buffers: 2696 kB' 'Cached: 18130564 kB' 'SwapCached: 0 kB' 'Active: 15081188 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957244 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619524 kB' 'Mapped: 204856 kB' 'Shmem: 13341376 kB' 'KReclaimable: 551268 kB' 'Slab: 1422144 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 870876 kB' 'KernelStack: 27584 kB' 'PageTables: 9784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15472552 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236344 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.648 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.648 14:50:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.649 14:50:40 -- setup/common.sh@33 -- # echo 0 00:02:59.649 14:50:40 -- setup/common.sh@33 -- # return 0 00:02:59.649 14:50:40 -- setup/hugepages.sh@100 -- # resv=0 00:02:59.649 14:50:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:59.649 nr_hugepages=1024 00:02:59.649 14:50:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:59.649 resv_hugepages=0 00:02:59.649 14:50:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:59.649 surplus_hugepages=0 00:02:59.649 14:50:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:59.649 anon_hugepages=0 00:02:59.649 14:50:40 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:59.649 14:50:40 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:59.649 14:50:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:59.649 14:50:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:59.649 14:50:40 -- setup/common.sh@18 -- # local node= 00:02:59.649 14:50:40 -- setup/common.sh@19 -- # local var val 00:02:59.649 14:50:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.649 14:50:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.649 14:50:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.649 14:50:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.649 14:50:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.649 14:50:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101012348 kB' 'MemAvailable: 105314556 kB' 'Buffers: 2696 kB' 'Cached: 18130592 kB' 'SwapCached: 0 kB' 'Active: 15080812 kB' 'Inactive: 3667940 kB' 'Active(anon): 13956868 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619040 kB' 'Mapped: 204856 kB' 'Shmem: 13341404 kB' 'KReclaimable: 551268 kB' 'Slab: 1422144 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 870876 kB' 'KernelStack: 27568 kB' 'PageTables: 9732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15472568 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236344 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.649 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.649 14:50:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.650 14:50:40 -- setup/common.sh@33 -- # echo 1024 00:02:59.650 14:50:40 -- setup/common.sh@33 -- # return 0 00:02:59.650 14:50:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:59.650 14:50:40 -- setup/hugepages.sh@112 -- # get_nodes 00:02:59.650 14:50:40 -- setup/hugepages.sh@27 -- # local node 00:02:59.650 14:50:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:59.650 14:50:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:59.650 14:50:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:59.650 14:50:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:59.650 14:50:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:59.650 14:50:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:59.650 14:50:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:59.650 14:50:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:59.650 14:50:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:59.650 14:50:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.650 14:50:40 -- setup/common.sh@18 -- # local node=0 00:02:59.650 14:50:40 -- setup/common.sh@19 -- # local var val 00:02:59.650 14:50:40 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.650 14:50:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.650 14:50:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:59.650 14:50:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:59.650 14:50:40 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.650 14:50:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 53567660 kB' 'MemUsed: 12091348 kB' 'SwapCached: 0 kB' 'Active: 6893204 kB' 'Inactive: 283864 kB' 'Active(anon): 6197276 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100780 kB' 'Mapped: 85476 kB' 'AnonPages: 79680 kB' 'Shmem: 6120988 kB' 'KernelStack: 14360 kB' 'PageTables: 3408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185308 kB' 'Slab: 678328 kB' 'SReclaimable: 185308 kB' 'SUnreclaim: 493020 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.650 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.650 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # continue 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.911 14:50:40 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.911 14:50:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.911 14:50:40 -- setup/common.sh@33 -- # echo 0 00:02:59.911 14:50:40 -- setup/common.sh@33 -- # return 0 00:02:59.911 14:50:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:59.911 14:50:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:59.911 14:50:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:59.911 14:50:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:59.911 14:50:40 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:59.912 node0=1024 expecting 1024 00:02:59.912 14:50:40 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:59.912 00:02:59.912 real 0m3.658s 00:02:59.912 user 0m1.395s 00:02:59.912 sys 0m2.240s 00:02:59.912 14:50:40 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:02:59.912 14:50:40 -- common/autotest_common.sh@10 -- # set +x 00:02:59.912 ************************************ 00:02:59.912 END TEST default_setup 00:02:59.912 ************************************ 00:02:59.912 14:50:40 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:59.912 14:50:40 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:59.912 14:50:40 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:59.912 14:50:40 -- common/autotest_common.sh@10 -- # set +x 00:02:59.912 ************************************ 00:02:59.912 START TEST per_node_1G_alloc 00:02:59.912 ************************************ 00:02:59.912 14:50:40 -- common/autotest_common.sh@1121 -- # per_node_1G_alloc 00:02:59.912 14:50:40 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:59.912 14:50:40 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:59.912 14:50:40 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:59.912 14:50:40 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:59.912 14:50:40 -- setup/hugepages.sh@51 -- # shift 00:02:59.912 14:50:40 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:59.912 14:50:40 -- setup/hugepages.sh@52 -- # local node_ids 00:02:59.912 14:50:40 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:59.912 14:50:40 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:59.912 14:50:40 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:59.912 14:50:40 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:59.912 14:50:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:59.912 14:50:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:59.912 14:50:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:59.912 14:50:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:59.912 14:50:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:59.912 14:50:40 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:59.912 14:50:40 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:59.912 14:50:40 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:59.912 14:50:40 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:59.912 14:50:40 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:59.912 14:50:40 -- setup/hugepages.sh@73 -- # return 0 00:02:59.912 14:50:40 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:59.912 14:50:40 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:59.912 14:50:40 -- setup/hugepages.sh@146 -- # setup output 00:02:59.912 14:50:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:59.912 14:50:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:03.291 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:03.291 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:03.291 14:50:44 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:03.291 14:50:44 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:03.291 14:50:44 -- setup/hugepages.sh@89 -- # local node 00:03:03.291 14:50:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:03.291 14:50:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:03.291 14:50:44 -- setup/hugepages.sh@92 -- # local surp 00:03:03.291 14:50:44 -- setup/hugepages.sh@93 -- # local resv 00:03:03.291 14:50:44 -- setup/hugepages.sh@94 -- # local anon 00:03:03.291 14:50:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:03.291 14:50:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:03.291 14:50:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:03.291 14:50:44 -- setup/common.sh@18 -- # local node= 00:03:03.291 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.291 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.291 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.291 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.291 14:50:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.291 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.291 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.291 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100986984 kB' 'MemAvailable: 105289192 kB' 'Buffers: 2696 kB' 'Cached: 18130680 kB' 'SwapCached: 0 kB' 'Active: 15079476 kB' 'Inactive: 3667940 kB' 'Active(anon): 13955532 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617556 kB' 'Mapped: 204236 kB' 'Shmem: 13341492 kB' 'KReclaimable: 551268 kB' 'Slab: 1422340 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871072 kB' 'KernelStack: 27520 kB' 'PageTables: 9528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457052 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236184 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.291 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.291 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:03.292 14:50:44 -- setup/common.sh@33 -- # echo 0 00:03:03.292 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.292 14:50:44 -- setup/hugepages.sh@97 -- # anon=0 00:03:03.292 14:50:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:03.292 14:50:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:03.292 14:50:44 -- setup/common.sh@18 -- # local node= 00:03:03.292 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.292 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.292 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.292 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.292 14:50:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.292 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.292 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100987296 kB' 'MemAvailable: 105289504 kB' 'Buffers: 2696 kB' 'Cached: 18130684 kB' 'SwapCached: 0 kB' 'Active: 15079672 kB' 'Inactive: 3667940 kB' 'Active(anon): 13955728 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617816 kB' 'Mapped: 203888 kB' 'Shmem: 13341496 kB' 'KReclaimable: 551268 kB' 'Slab: 1422328 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871060 kB' 'KernelStack: 27504 kB' 'PageTables: 9456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457064 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236120 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.292 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.292 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.293 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.293 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.293 14:50:44 -- setup/common.sh@33 -- # echo 0 00:03:03.293 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.293 14:50:44 -- setup/hugepages.sh@99 -- # surp=0 00:03:03.293 14:50:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:03.293 14:50:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:03.293 14:50:44 -- setup/common.sh@18 -- # local node= 00:03:03.293 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.293 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.293 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.293 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.293 14:50:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.293 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.294 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100987480 kB' 'MemAvailable: 105289688 kB' 'Buffers: 2696 kB' 'Cached: 18130696 kB' 'SwapCached: 0 kB' 'Active: 15078780 kB' 'Inactive: 3667940 kB' 'Active(anon): 13954836 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 616892 kB' 'Mapped: 203884 kB' 'Shmem: 13341508 kB' 'KReclaimable: 551268 kB' 'Slab: 1422288 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871020 kB' 'KernelStack: 27504 kB' 'PageTables: 9452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457080 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236136 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.294 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.294 14:50:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:03.295 14:50:44 -- setup/common.sh@33 -- # echo 0 00:03:03.295 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.295 14:50:44 -- setup/hugepages.sh@100 -- # resv=0 00:03:03.295 14:50:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:03.295 nr_hugepages=1024 00:03:03.295 14:50:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:03.295 resv_hugepages=0 00:03:03.295 14:50:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:03.295 surplus_hugepages=0 00:03:03.295 14:50:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:03.295 anon_hugepages=0 00:03:03.295 14:50:44 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:03.295 14:50:44 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:03.295 14:50:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:03.295 14:50:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:03.295 14:50:44 -- setup/common.sh@18 -- # local node= 00:03:03.295 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.295 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.295 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.295 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:03.295 14:50:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:03.295 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.295 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.295 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100993836 kB' 'MemAvailable: 105296044 kB' 'Buffers: 2696 kB' 'Cached: 18130708 kB' 'SwapCached: 0 kB' 'Active: 15079308 kB' 'Inactive: 3667940 kB' 'Active(anon): 13955364 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617580 kB' 'Mapped: 204000 kB' 'Shmem: 13341520 kB' 'KReclaimable: 551268 kB' 'Slab: 1422320 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871052 kB' 'KernelStack: 27536 kB' 'PageTables: 9592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457092 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236152 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.295 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.295 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:03.296 14:50:44 -- setup/common.sh@33 -- # echo 1024 00:03:03.296 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.296 14:50:44 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:03.296 14:50:44 -- setup/hugepages.sh@112 -- # get_nodes 00:03:03.296 14:50:44 -- setup/hugepages.sh@27 -- # local node 00:03:03.296 14:50:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:03.296 14:50:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:03.296 14:50:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:03.296 14:50:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:03.296 14:50:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:03.296 14:50:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:03.296 14:50:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:03.296 14:50:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:03.296 14:50:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:03.296 14:50:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:03.296 14:50:44 -- setup/common.sh@18 -- # local node=0 00:03:03.296 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.296 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.296 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.296 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:03.296 14:50:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:03.296 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.296 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54620508 kB' 'MemUsed: 11038500 kB' 'SwapCached: 0 kB' 'Active: 6890684 kB' 'Inactive: 283864 kB' 'Active(anon): 6194756 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100820 kB' 'Mapped: 84492 kB' 'AnonPages: 76980 kB' 'Shmem: 6121028 kB' 'KernelStack: 14248 kB' 'PageTables: 3080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185308 kB' 'Slab: 678156 kB' 'SReclaimable: 185308 kB' 'SUnreclaim: 492848 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.296 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.296 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@33 -- # echo 0 00:03:03.297 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.297 14:50:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:03.297 14:50:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:03.297 14:50:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:03.297 14:50:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:03.297 14:50:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:03.297 14:50:44 -- setup/common.sh@18 -- # local node=1 00:03:03.297 14:50:44 -- setup/common.sh@19 -- # local var val 00:03:03.297 14:50:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:03.297 14:50:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:03.297 14:50:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:03.297 14:50:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:03.297 14:50:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:03.297 14:50:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 46374788 kB' 'MemUsed: 14305108 kB' 'SwapCached: 0 kB' 'Active: 8189336 kB' 'Inactive: 3384076 kB' 'Active(anon): 7761320 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11032612 kB' 'Mapped: 119540 kB' 'AnonPages: 541104 kB' 'Shmem: 7220520 kB' 'KernelStack: 13192 kB' 'PageTables: 6148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 365960 kB' 'Slab: 744128 kB' 'SReclaimable: 365960 kB' 'SUnreclaim: 378168 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.297 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.297 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.298 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.298 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.298 14:50:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.298 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.298 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.298 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.298 14:50:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # continue 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:03.570 14:50:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:03.570 14:50:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:03.570 14:50:44 -- setup/common.sh@33 -- # echo 0 00:03:03.570 14:50:44 -- setup/common.sh@33 -- # return 0 00:03:03.570 14:50:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:03.570 14:50:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:03.570 14:50:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:03.570 14:50:44 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:03.570 node0=512 expecting 512 00:03:03.570 14:50:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:03.570 14:50:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:03.570 14:50:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:03.570 14:50:44 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:03.570 node1=512 expecting 512 00:03:03.570 14:50:44 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:03.570 00:03:03.570 real 0m3.440s 00:03:03.570 user 0m1.427s 00:03:03.570 sys 0m2.066s 00:03:03.570 14:50:44 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:03.570 14:50:44 -- common/autotest_common.sh@10 -- # set +x 00:03:03.570 ************************************ 00:03:03.570 END TEST per_node_1G_alloc 00:03:03.570 ************************************ 00:03:03.570 14:50:44 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:03.570 14:50:44 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:03.570 14:50:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:03.570 14:50:44 -- common/autotest_common.sh@10 -- # set +x 00:03:03.570 ************************************ 00:03:03.570 START TEST even_2G_alloc 00:03:03.570 ************************************ 00:03:03.570 14:50:44 -- common/autotest_common.sh@1121 -- # even_2G_alloc 00:03:03.570 14:50:44 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:03.570 14:50:44 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:03.570 14:50:44 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:03.570 14:50:44 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:03.570 14:50:44 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:03.570 14:50:44 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:03.570 14:50:44 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:03.570 14:50:44 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:03.570 14:50:44 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:03.570 14:50:44 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:03.570 14:50:44 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:03.570 14:50:44 -- setup/hugepages.sh@83 -- # : 512 00:03:03.570 14:50:44 -- setup/hugepages.sh@84 -- # : 1 00:03:03.570 14:50:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:03.570 14:50:44 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:03.570 14:50:44 -- setup/hugepages.sh@83 -- # : 0 00:03:03.570 14:50:44 -- setup/hugepages.sh@84 -- # : 0 00:03:03.570 14:50:44 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:03.571 14:50:44 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:03.571 14:50:44 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:03.571 14:50:44 -- setup/hugepages.sh@153 -- # setup output 00:03:03.571 14:50:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.571 14:50:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:06.873 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:06.873 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:06.873 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:07.138 14:50:47 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:07.138 14:50:47 -- setup/hugepages.sh@89 -- # local node 00:03:07.138 14:50:47 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:07.138 14:50:47 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:07.138 14:50:47 -- setup/hugepages.sh@92 -- # local surp 00:03:07.138 14:50:47 -- setup/hugepages.sh@93 -- # local resv 00:03:07.138 14:50:47 -- setup/hugepages.sh@94 -- # local anon 00:03:07.138 14:50:47 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:07.138 14:50:47 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:07.138 14:50:47 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:07.138 14:50:47 -- setup/common.sh@18 -- # local node= 00:03:07.138 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.138 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.138 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.138 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.138 14:50:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.138 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.138 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100999156 kB' 'MemAvailable: 105301364 kB' 'Buffers: 2696 kB' 'Cached: 18130820 kB' 'SwapCached: 0 kB' 'Active: 15079732 kB' 'Inactive: 3667940 kB' 'Active(anon): 13955788 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617540 kB' 'Mapped: 204020 kB' 'Shmem: 13341632 kB' 'KReclaimable: 551268 kB' 'Slab: 1422416 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871148 kB' 'KernelStack: 27456 kB' 'PageTables: 9264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457880 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236216 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.138 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.138 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.139 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:07.139 14:50:47 -- setup/common.sh@33 -- # echo 0 00:03:07.139 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.139 14:50:47 -- setup/hugepages.sh@97 -- # anon=0 00:03:07.139 14:50:47 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:07.139 14:50:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:07.139 14:50:47 -- setup/common.sh@18 -- # local node= 00:03:07.139 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.139 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.139 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.139 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.139 14:50:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.139 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.139 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.139 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100999568 kB' 'MemAvailable: 105301776 kB' 'Buffers: 2696 kB' 'Cached: 18130820 kB' 'SwapCached: 0 kB' 'Active: 15080120 kB' 'Inactive: 3667940 kB' 'Active(anon): 13956176 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617896 kB' 'Mapped: 203944 kB' 'Shmem: 13341632 kB' 'KReclaimable: 551268 kB' 'Slab: 1422400 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871132 kB' 'KernelStack: 27520 kB' 'PageTables: 9444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457892 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236184 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.140 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.140 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.141 14:50:47 -- setup/common.sh@33 -- # echo 0 00:03:07.141 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.141 14:50:47 -- setup/hugepages.sh@99 -- # surp=0 00:03:07.141 14:50:47 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:07.141 14:50:47 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:07.141 14:50:47 -- setup/common.sh@18 -- # local node= 00:03:07.141 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.141 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.141 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.141 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.141 14:50:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.141 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.141 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100999536 kB' 'MemAvailable: 105301744 kB' 'Buffers: 2696 kB' 'Cached: 18130824 kB' 'SwapCached: 0 kB' 'Active: 15079892 kB' 'Inactive: 3667940 kB' 'Active(anon): 13955948 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617716 kB' 'Mapped: 203944 kB' 'Shmem: 13341636 kB' 'KReclaimable: 551268 kB' 'Slab: 1422400 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871132 kB' 'KernelStack: 27520 kB' 'PageTables: 9444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457912 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236200 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.141 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.141 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.142 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.142 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:07.143 14:50:47 -- setup/common.sh@33 -- # echo 0 00:03:07.143 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.143 14:50:47 -- setup/hugepages.sh@100 -- # resv=0 00:03:07.143 14:50:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:07.143 nr_hugepages=1024 00:03:07.143 14:50:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:07.143 resv_hugepages=0 00:03:07.143 14:50:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:07.143 surplus_hugepages=0 00:03:07.143 14:50:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:07.143 anon_hugepages=0 00:03:07.143 14:50:47 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:07.143 14:50:47 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:07.143 14:50:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:07.143 14:50:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:07.143 14:50:47 -- setup/common.sh@18 -- # local node= 00:03:07.143 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.143 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.143 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.143 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.143 14:50:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.143 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.143 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100999852 kB' 'MemAvailable: 105302060 kB' 'Buffers: 2696 kB' 'Cached: 18130824 kB' 'SwapCached: 0 kB' 'Active: 15080260 kB' 'Inactive: 3667940 kB' 'Active(anon): 13956316 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617540 kB' 'Mapped: 203928 kB' 'Shmem: 13341636 kB' 'KReclaimable: 551268 kB' 'Slab: 1422364 kB' 'SReclaimable: 551268 kB' 'SUnreclaim: 871096 kB' 'KernelStack: 27488 kB' 'PageTables: 9332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15457928 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236216 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.143 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.143 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.144 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.144 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:07.145 14:50:47 -- setup/common.sh@33 -- # echo 1024 00:03:07.145 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.145 14:50:47 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:07.145 14:50:47 -- setup/hugepages.sh@112 -- # get_nodes 00:03:07.145 14:50:47 -- setup/hugepages.sh@27 -- # local node 00:03:07.145 14:50:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.145 14:50:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:07.145 14:50:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.145 14:50:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:07.145 14:50:47 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:07.145 14:50:47 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:07.145 14:50:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:07.145 14:50:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:07.145 14:50:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:07.145 14:50:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:07.145 14:50:47 -- setup/common.sh@18 -- # local node=0 00:03:07.145 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.145 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.145 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.145 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:07.145 14:50:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:07.145 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.145 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.145 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54615828 kB' 'MemUsed: 11043180 kB' 'SwapCached: 0 kB' 'Active: 6891064 kB' 'Inactive: 283864 kB' 'Active(anon): 6195136 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100896 kB' 'Mapped: 84536 kB' 'AnonPages: 77172 kB' 'Shmem: 6121104 kB' 'KernelStack: 14248 kB' 'PageTables: 3088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185308 kB' 'Slab: 677992 kB' 'SReclaimable: 185308 kB' 'SUnreclaim: 492684 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.145 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.145 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.146 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.146 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.146 14:50:47 -- setup/common.sh@33 -- # echo 0 00:03:07.146 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.146 14:50:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:07.146 14:50:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:07.146 14:50:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:07.146 14:50:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:07.146 14:50:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:07.146 14:50:47 -- setup/common.sh@18 -- # local node=1 00:03:07.146 14:50:47 -- setup/common.sh@19 -- # local var val 00:03:07.146 14:50:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.146 14:50:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.147 14:50:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:07.147 14:50:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:07.147 14:50:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.147 14:50:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 46383404 kB' 'MemUsed: 14296492 kB' 'SwapCached: 0 kB' 'Active: 8188984 kB' 'Inactive: 3384076 kB' 'Active(anon): 7760968 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11032680 kB' 'Mapped: 119392 kB' 'AnonPages: 540624 kB' 'Shmem: 7220588 kB' 'KernelStack: 13272 kB' 'PageTables: 6404 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 365960 kB' 'Slab: 744372 kB' 'SReclaimable: 365960 kB' 'SUnreclaim: 378412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.147 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.147 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # continue 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.148 14:50:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.148 14:50:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:07.148 14:50:47 -- setup/common.sh@33 -- # echo 0 00:03:07.148 14:50:47 -- setup/common.sh@33 -- # return 0 00:03:07.148 14:50:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:07.148 14:50:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:07.148 14:50:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:07.148 14:50:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:07.148 14:50:47 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:07.148 node0=512 expecting 512 00:03:07.148 14:50:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:07.148 14:50:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:07.148 14:50:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:07.148 14:50:47 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:07.148 node1=512 expecting 512 00:03:07.148 14:50:47 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:07.148 00:03:07.148 real 0m3.536s 00:03:07.148 user 0m1.416s 00:03:07.148 sys 0m2.170s 00:03:07.148 14:50:47 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:07.148 14:50:47 -- common/autotest_common.sh@10 -- # set +x 00:03:07.148 ************************************ 00:03:07.148 END TEST even_2G_alloc 00:03:07.148 ************************************ 00:03:07.148 14:50:47 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:07.148 14:50:47 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:07.148 14:50:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:07.148 14:50:47 -- common/autotest_common.sh@10 -- # set +x 00:03:07.410 ************************************ 00:03:07.410 START TEST odd_alloc 00:03:07.410 ************************************ 00:03:07.410 14:50:48 -- common/autotest_common.sh@1121 -- # odd_alloc 00:03:07.410 14:50:48 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:07.410 14:50:48 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:07.410 14:50:48 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:07.410 14:50:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:07.410 14:50:48 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:07.410 14:50:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:07.410 14:50:48 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:07.410 14:50:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:07.410 14:50:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:07.410 14:50:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:07.410 14:50:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:07.410 14:50:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:07.410 14:50:48 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:07.411 14:50:48 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:07.411 14:50:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:07.411 14:50:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:07.411 14:50:48 -- setup/hugepages.sh@83 -- # : 513 00:03:07.411 14:50:48 -- setup/hugepages.sh@84 -- # : 1 00:03:07.411 14:50:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:07.411 14:50:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:07.411 14:50:48 -- setup/hugepages.sh@83 -- # : 0 00:03:07.411 14:50:48 -- setup/hugepages.sh@84 -- # : 0 00:03:07.411 14:50:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:07.411 14:50:48 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:07.411 14:50:48 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:07.411 14:50:48 -- setup/hugepages.sh@160 -- # setup output 00:03:07.411 14:50:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.411 14:50:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:10.720 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:10.720 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:10.720 14:50:51 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:10.720 14:50:51 -- setup/hugepages.sh@89 -- # local node 00:03:10.720 14:50:51 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:10.720 14:50:51 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:10.720 14:50:51 -- setup/hugepages.sh@92 -- # local surp 00:03:10.720 14:50:51 -- setup/hugepages.sh@93 -- # local resv 00:03:10.720 14:50:51 -- setup/hugepages.sh@94 -- # local anon 00:03:10.720 14:50:51 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:10.720 14:50:51 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:10.720 14:50:51 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:10.720 14:50:51 -- setup/common.sh@18 -- # local node= 00:03:10.720 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.720 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.720 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.720 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.720 14:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.720 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.720 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.720 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.720 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101002108 kB' 'MemAvailable: 105304284 kB' 'Buffers: 2696 kB' 'Cached: 18130980 kB' 'SwapCached: 0 kB' 'Active: 15081772 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957828 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 618824 kB' 'Mapped: 204044 kB' 'Shmem: 13341792 kB' 'KReclaimable: 551236 kB' 'Slab: 1421964 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870728 kB' 'KernelStack: 27520 kB' 'PageTables: 9532 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15460832 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236296 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.721 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.721 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.722 14:50:51 -- setup/common.sh@33 -- # echo 0 00:03:10.722 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.722 14:50:51 -- setup/hugepages.sh@97 -- # anon=0 00:03:10.722 14:50:51 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:10.722 14:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.722 14:50:51 -- setup/common.sh@18 -- # local node= 00:03:10.722 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.722 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.722 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.722 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.722 14:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.722 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.722 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101005064 kB' 'MemAvailable: 105307240 kB' 'Buffers: 2696 kB' 'Cached: 18130984 kB' 'SwapCached: 0 kB' 'Active: 15082416 kB' 'Inactive: 3667940 kB' 'Active(anon): 13958472 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619532 kB' 'Mapped: 204044 kB' 'Shmem: 13341796 kB' 'KReclaimable: 551236 kB' 'Slab: 1421944 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870708 kB' 'KernelStack: 27568 kB' 'PageTables: 9340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15460632 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236280 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.722 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.722 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.723 14:50:51 -- setup/common.sh@33 -- # echo 0 00:03:10.723 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.723 14:50:51 -- setup/hugepages.sh@99 -- # surp=0 00:03:10.723 14:50:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:10.723 14:50:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:10.723 14:50:51 -- setup/common.sh@18 -- # local node= 00:03:10.723 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.723 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.723 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.723 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.723 14:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.723 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.723 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101005020 kB' 'MemAvailable: 105307196 kB' 'Buffers: 2696 kB' 'Cached: 18130996 kB' 'SwapCached: 0 kB' 'Active: 15080312 kB' 'Inactive: 3667940 kB' 'Active(anon): 13956368 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 617784 kB' 'Mapped: 203964 kB' 'Shmem: 13341808 kB' 'KReclaimable: 551236 kB' 'Slab: 1421944 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870708 kB' 'KernelStack: 27472 kB' 'PageTables: 9508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15460520 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236264 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.723 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.723 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.724 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.724 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.725 14:50:51 -- setup/common.sh@33 -- # echo 0 00:03:10.725 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.725 14:50:51 -- setup/hugepages.sh@100 -- # resv=0 00:03:10.725 14:50:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:10.725 nr_hugepages=1025 00:03:10.725 14:50:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:10.725 resv_hugepages=0 00:03:10.725 14:50:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:10.725 surplus_hugepages=0 00:03:10.725 14:50:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:10.725 anon_hugepages=0 00:03:10.725 14:50:51 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:10.725 14:50:51 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:10.725 14:50:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:10.725 14:50:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:10.725 14:50:51 -- setup/common.sh@18 -- # local node= 00:03:10.725 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.725 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.725 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.725 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.725 14:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.725 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.725 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101004244 kB' 'MemAvailable: 105306420 kB' 'Buffers: 2696 kB' 'Cached: 18130996 kB' 'SwapCached: 0 kB' 'Active: 15081676 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957732 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619148 kB' 'Mapped: 204468 kB' 'Shmem: 13341808 kB' 'KReclaimable: 551236 kB' 'Slab: 1421944 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870708 kB' 'KernelStack: 27408 kB' 'PageTables: 9328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70508456 kB' 'Committed_AS: 15462384 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236200 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.725 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.725 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.726 14:50:51 -- setup/common.sh@33 -- # echo 1025 00:03:10.726 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.726 14:50:51 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:10.726 14:50:51 -- setup/hugepages.sh@112 -- # get_nodes 00:03:10.726 14:50:51 -- setup/hugepages.sh@27 -- # local node 00:03:10.726 14:50:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.726 14:50:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:10.726 14:50:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.726 14:50:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:10.726 14:50:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.726 14:50:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.726 14:50:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.726 14:50:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.726 14:50:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:10.726 14:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.726 14:50:51 -- setup/common.sh@18 -- # local node=0 00:03:10.726 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.726 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.726 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.726 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:10.726 14:50:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:10.726 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.726 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54627152 kB' 'MemUsed: 11031856 kB' 'SwapCached: 0 kB' 'Active: 6891780 kB' 'Inactive: 283864 kB' 'Active(anon): 6195852 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100968 kB' 'Mapped: 85076 kB' 'AnonPages: 77920 kB' 'Shmem: 6121176 kB' 'KernelStack: 14376 kB' 'PageTables: 3036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185276 kB' 'Slab: 677340 kB' 'SReclaimable: 185276 kB' 'SUnreclaim: 492064 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.726 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.726 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.727 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.727 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.989 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.989 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@33 -- # echo 0 00:03:10.990 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.990 14:50:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.990 14:50:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.990 14:50:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.990 14:50:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:10.990 14:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.990 14:50:51 -- setup/common.sh@18 -- # local node=1 00:03:10.990 14:50:51 -- setup/common.sh@19 -- # local var val 00:03:10.990 14:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.990 14:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.990 14:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:10.990 14:50:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:10.990 14:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.990 14:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 46371472 kB' 'MemUsed: 14308424 kB' 'SwapCached: 0 kB' 'Active: 8189376 kB' 'Inactive: 3384076 kB' 'Active(anon): 7761360 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11032768 kB' 'Mapped: 119548 kB' 'AnonPages: 540864 kB' 'Shmem: 7220676 kB' 'KernelStack: 13256 kB' 'PageTables: 6404 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 365960 kB' 'Slab: 744604 kB' 'SReclaimable: 365960 kB' 'SUnreclaim: 378644 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.990 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.990 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # continue 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.991 14:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.991 14:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.991 14:50:51 -- setup/common.sh@33 -- # echo 0 00:03:10.991 14:50:51 -- setup/common.sh@33 -- # return 0 00:03:10.991 14:50:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.991 14:50:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.991 14:50:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:10.991 node0=512 expecting 513 00:03:10.991 14:50:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.991 14:50:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.991 14:50:51 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:10.991 node1=513 expecting 512 00:03:10.991 14:50:51 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:10.991 00:03:10.991 real 0m3.583s 00:03:10.991 user 0m1.402s 00:03:10.991 sys 0m2.232s 00:03:10.991 14:50:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:10.991 14:50:51 -- common/autotest_common.sh@10 -- # set +x 00:03:10.991 ************************************ 00:03:10.991 END TEST odd_alloc 00:03:10.991 ************************************ 00:03:10.991 14:50:51 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:10.991 14:50:51 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:10.991 14:50:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:10.991 14:50:51 -- common/autotest_common.sh@10 -- # set +x 00:03:10.991 ************************************ 00:03:10.991 START TEST custom_alloc 00:03:10.991 ************************************ 00:03:10.991 14:50:51 -- common/autotest_common.sh@1121 -- # custom_alloc 00:03:10.991 14:50:51 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:10.991 14:50:51 -- setup/hugepages.sh@169 -- # local node 00:03:10.991 14:50:51 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:10.991 14:50:51 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:10.991 14:50:51 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:10.991 14:50:51 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:10.991 14:50:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:10.991 14:50:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.991 14:50:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:10.991 14:50:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.991 14:50:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:10.991 14:50:51 -- setup/hugepages.sh@83 -- # : 256 00:03:10.991 14:50:51 -- setup/hugepages.sh@84 -- # : 1 00:03:10.991 14:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:10.991 14:50:51 -- setup/hugepages.sh@83 -- # : 0 00:03:10.991 14:50:51 -- setup/hugepages.sh@84 -- # : 0 00:03:10.991 14:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:10.991 14:50:51 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:10.991 14:50:51 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:10.991 14:50:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:10.991 14:50:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.991 14:50:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:10.991 14:50:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.991 14:50:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:10.991 14:50:51 -- setup/hugepages.sh@78 -- # return 0 00:03:10.991 14:50:51 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:10.991 14:50:51 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:10.991 14:50:51 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:10.991 14:50:51 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.991 14:50:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:10.991 14:50:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.991 14:50:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.991 14:50:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:10.991 14:50:51 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:10.991 14:50:51 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:10.992 14:50:51 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:10.992 14:50:51 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:10.992 14:50:51 -- setup/hugepages.sh@78 -- # return 0 00:03:10.992 14:50:51 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:10.992 14:50:51 -- setup/hugepages.sh@187 -- # setup output 00:03:10.992 14:50:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.992 14:50:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:14.302 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:14.302 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:14.302 14:50:54 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:14.302 14:50:54 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:14.302 14:50:54 -- setup/hugepages.sh@89 -- # local node 00:03:14.302 14:50:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.302 14:50:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.302 14:50:54 -- setup/hugepages.sh@92 -- # local surp 00:03:14.302 14:50:54 -- setup/hugepages.sh@93 -- # local resv 00:03:14.302 14:50:54 -- setup/hugepages.sh@94 -- # local anon 00:03:14.302 14:50:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.302 14:50:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.302 14:50:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.302 14:50:54 -- setup/common.sh@18 -- # local node= 00:03:14.302 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.302 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.302 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.302 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.302 14:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.302 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.302 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.302 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.302 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 99951416 kB' 'MemAvailable: 104253592 kB' 'Buffers: 2696 kB' 'Cached: 18131100 kB' 'SwapCached: 0 kB' 'Active: 15081696 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957752 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 618520 kB' 'Mapped: 204024 kB' 'Shmem: 13341912 kB' 'KReclaimable: 551236 kB' 'Slab: 1421932 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870696 kB' 'KernelStack: 27536 kB' 'PageTables: 9496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15459680 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236360 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.303 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.303 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.304 14:50:54 -- setup/common.sh@33 -- # echo 0 00:03:14.304 14:50:54 -- setup/common.sh@33 -- # return 0 00:03:14.304 14:50:54 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.304 14:50:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.304 14:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.304 14:50:54 -- setup/common.sh@18 -- # local node= 00:03:14.304 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.304 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.304 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.304 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.304 14:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.304 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.304 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 99951772 kB' 'MemAvailable: 104253948 kB' 'Buffers: 2696 kB' 'Cached: 18131104 kB' 'SwapCached: 0 kB' 'Active: 15081832 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957888 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619172 kB' 'Mapped: 204508 kB' 'Shmem: 13341916 kB' 'KReclaimable: 551236 kB' 'Slab: 1421932 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870696 kB' 'KernelStack: 27520 kB' 'PageTables: 9440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15461048 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236312 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.304 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.304 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.305 14:50:54 -- setup/common.sh@33 -- # echo 0 00:03:14.305 14:50:54 -- setup/common.sh@33 -- # return 0 00:03:14.305 14:50:54 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.305 14:50:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.305 14:50:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.305 14:50:54 -- setup/common.sh@18 -- # local node= 00:03:14.305 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.305 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.305 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.305 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.305 14:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.305 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.305 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.305 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 99948256 kB' 'MemAvailable: 104250432 kB' 'Buffers: 2696 kB' 'Cached: 18131104 kB' 'SwapCached: 0 kB' 'Active: 15083668 kB' 'Inactive: 3667940 kB' 'Active(anon): 13959724 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621008 kB' 'Mapped: 204508 kB' 'Shmem: 13341916 kB' 'KReclaimable: 551236 kB' 'Slab: 1422004 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870768 kB' 'KernelStack: 27488 kB' 'PageTables: 9356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15463044 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236312 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.305 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.305 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.306 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.306 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.307 14:50:54 -- setup/common.sh@33 -- # echo 0 00:03:14.307 14:50:54 -- setup/common.sh@33 -- # return 0 00:03:14.307 14:50:54 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.307 14:50:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:14.307 nr_hugepages=1536 00:03:14.307 14:50:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.307 resv_hugepages=0 00:03:14.307 14:50:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.307 surplus_hugepages=0 00:03:14.307 14:50:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.307 anon_hugepages=0 00:03:14.307 14:50:54 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:14.307 14:50:54 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:14.307 14:50:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.307 14:50:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.307 14:50:54 -- setup/common.sh@18 -- # local node= 00:03:14.307 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.307 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.307 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.307 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.307 14:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.307 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.307 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 99943216 kB' 'MemAvailable: 104245392 kB' 'Buffers: 2696 kB' 'Cached: 18131128 kB' 'SwapCached: 0 kB' 'Active: 15087984 kB' 'Inactive: 3667940 kB' 'Active(anon): 13964040 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 620276 kB' 'Mapped: 204416 kB' 'Shmem: 13341940 kB' 'KReclaimable: 551236 kB' 'Slab: 1422004 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870768 kB' 'KernelStack: 27536 kB' 'PageTables: 9564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 69985192 kB' 'Committed_AS: 15483600 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236328 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.307 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.307 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.308 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.308 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.308 14:50:54 -- setup/common.sh@33 -- # echo 1536 00:03:14.308 14:50:54 -- setup/common.sh@33 -- # return 0 00:03:14.308 14:50:54 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:14.308 14:50:54 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.308 14:50:54 -- setup/hugepages.sh@27 -- # local node 00:03:14.308 14:50:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.308 14:50:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.308 14:50:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.308 14:50:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:14.308 14:50:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.308 14:50:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.308 14:50:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.308 14:50:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.308 14:50:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.308 14:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.308 14:50:54 -- setup/common.sh@18 -- # local node=0 00:03:14.308 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.308 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.308 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.308 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.308 14:50:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.308 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.308 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 54611204 kB' 'MemUsed: 11047804 kB' 'SwapCached: 0 kB' 'Active: 6890280 kB' 'Inactive: 283864 kB' 'Active(anon): 6194352 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100972 kB' 'Mapped: 84612 kB' 'AnonPages: 76268 kB' 'Shmem: 6121180 kB' 'KernelStack: 14232 kB' 'PageTables: 3028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185276 kB' 'Slab: 677300 kB' 'SReclaimable: 185276 kB' 'SUnreclaim: 492024 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.309 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.309 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@33 -- # echo 0 00:03:14.310 14:50:54 -- setup/common.sh@33 -- # return 0 00:03:14.310 14:50:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.310 14:50:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.310 14:50:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.310 14:50:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.310 14:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.310 14:50:54 -- setup/common.sh@18 -- # local node=1 00:03:14.310 14:50:54 -- setup/common.sh@19 -- # local var val 00:03:14.310 14:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.310 14:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.310 14:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.310 14:50:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.310 14:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.310 14:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60679896 kB' 'MemFree: 45333144 kB' 'MemUsed: 15346752 kB' 'SwapCached: 0 kB' 'Active: 8190984 kB' 'Inactive: 3384076 kB' 'Active(anon): 7762968 kB' 'Inactive(anon): 0 kB' 'Active(file): 428016 kB' 'Inactive(file): 3384076 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 11032888 kB' 'Mapped: 119392 kB' 'AnonPages: 542288 kB' 'Shmem: 7220796 kB' 'KernelStack: 13256 kB' 'PageTables: 6292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 365960 kB' 'Slab: 744704 kB' 'SReclaimable: 365960 kB' 'SUnreclaim: 378744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.310 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.310 14:50:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # continue 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.311 14:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.311 14:50:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.311 14:50:55 -- setup/common.sh@33 -- # echo 0 00:03:14.311 14:50:55 -- setup/common.sh@33 -- # return 0 00:03:14.311 14:50:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.311 14:50:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.311 14:50:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.311 14:50:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.311 14:50:55 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:14.311 node0=512 expecting 512 00:03:14.311 14:50:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.311 14:50:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.311 14:50:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.311 14:50:55 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:14.311 node1=1024 expecting 1024 00:03:14.311 14:50:55 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:14.311 00:03:14.311 real 0m3.113s 00:03:14.311 user 0m1.216s 00:03:14.311 sys 0m1.883s 00:03:14.311 14:50:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:14.311 14:50:55 -- common/autotest_common.sh@10 -- # set +x 00:03:14.311 ************************************ 00:03:14.311 END TEST custom_alloc 00:03:14.311 ************************************ 00:03:14.311 14:50:55 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:14.311 14:50:55 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:14.311 14:50:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:14.311 14:50:55 -- common/autotest_common.sh@10 -- # set +x 00:03:14.311 ************************************ 00:03:14.311 START TEST no_shrink_alloc 00:03:14.311 ************************************ 00:03:14.311 14:50:55 -- common/autotest_common.sh@1121 -- # no_shrink_alloc 00:03:14.311 14:50:55 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:14.311 14:50:55 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:14.311 14:50:55 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:14.311 14:50:55 -- setup/hugepages.sh@51 -- # shift 00:03:14.311 14:50:55 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:14.311 14:50:55 -- setup/hugepages.sh@52 -- # local node_ids 00:03:14.311 14:50:55 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.311 14:50:55 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:14.311 14:50:55 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:14.311 14:50:55 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:14.311 14:50:55 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.311 14:50:55 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.311 14:50:55 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.311 14:50:55 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.311 14:50:55 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.311 14:50:55 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:14.311 14:50:55 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.311 14:50:55 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:14.311 14:50:55 -- setup/hugepages.sh@73 -- # return 0 00:03:14.311 14:50:55 -- setup/hugepages.sh@198 -- # setup output 00:03:14.311 14:50:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.311 14:50:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:17.621 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:17.621 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:17.621 14:50:57 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:17.621 14:50:57 -- setup/hugepages.sh@89 -- # local node 00:03:17.621 14:50:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.621 14:50:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.621 14:50:57 -- setup/hugepages.sh@92 -- # local surp 00:03:17.621 14:50:57 -- setup/hugepages.sh@93 -- # local resv 00:03:17.621 14:50:57 -- setup/hugepages.sh@94 -- # local anon 00:03:17.621 14:50:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.621 14:50:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.621 14:50:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.621 14:50:57 -- setup/common.sh@18 -- # local node= 00:03:17.621 14:50:57 -- setup/common.sh@19 -- # local var val 00:03:17.621 14:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.621 14:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.621 14:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.621 14:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.621 14:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.621 14:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101020448 kB' 'MemAvailable: 105322624 kB' 'Buffers: 2696 kB' 'Cached: 18131248 kB' 'SwapCached: 0 kB' 'Active: 15082260 kB' 'Inactive: 3667940 kB' 'Active(anon): 13958316 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619564 kB' 'Mapped: 204068 kB' 'Shmem: 13342060 kB' 'KReclaimable: 551236 kB' 'Slab: 1421620 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870384 kB' 'KernelStack: 27536 kB' 'PageTables: 9492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15460276 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236344 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.621 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.621 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.622 14:50:57 -- setup/common.sh@33 -- # echo 0 00:03:17.622 14:50:57 -- setup/common.sh@33 -- # return 0 00:03:17.622 14:50:57 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.622 14:50:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.622 14:50:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.622 14:50:57 -- setup/common.sh@18 -- # local node= 00:03:17.622 14:50:57 -- setup/common.sh@19 -- # local var val 00:03:17.622 14:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.622 14:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.622 14:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.622 14:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.622 14:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.622 14:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101020196 kB' 'MemAvailable: 105322372 kB' 'Buffers: 2696 kB' 'Cached: 18131252 kB' 'SwapCached: 0 kB' 'Active: 15081904 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957960 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619248 kB' 'Mapped: 204036 kB' 'Shmem: 13342064 kB' 'KReclaimable: 551236 kB' 'Slab: 1421600 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870364 kB' 'KernelStack: 27520 kB' 'PageTables: 9428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15460288 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236328 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:17.622 14:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.622 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.622 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.623 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.623 14:50:58 -- setup/common.sh@33 -- # echo 0 00:03:17.623 14:50:58 -- setup/common.sh@33 -- # return 0 00:03:17.623 14:50:58 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.623 14:50:58 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.623 14:50:58 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.623 14:50:58 -- setup/common.sh@18 -- # local node= 00:03:17.623 14:50:58 -- setup/common.sh@19 -- # local var val 00:03:17.623 14:50:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.623 14:50:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.623 14:50:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.623 14:50:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.623 14:50:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.623 14:50:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.623 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101019956 kB' 'MemAvailable: 105322132 kB' 'Buffers: 2696 kB' 'Cached: 18131252 kB' 'SwapCached: 0 kB' 'Active: 15081880 kB' 'Inactive: 3667940 kB' 'Active(anon): 13957936 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619224 kB' 'Mapped: 204036 kB' 'Shmem: 13342064 kB' 'KReclaimable: 551236 kB' 'Slab: 1421636 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870400 kB' 'KernelStack: 27520 kB' 'PageTables: 9448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15460300 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236328 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.624 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.624 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.625 14:50:58 -- setup/common.sh@33 -- # echo 0 00:03:17.625 14:50:58 -- setup/common.sh@33 -- # return 0 00:03:17.625 14:50:58 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.625 14:50:58 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.625 nr_hugepages=1024 00:03:17.625 14:50:58 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.625 resv_hugepages=0 00:03:17.625 14:50:58 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.625 surplus_hugepages=0 00:03:17.625 14:50:58 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.625 anon_hugepages=0 00:03:17.625 14:50:58 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.625 14:50:58 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.625 14:50:58 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.625 14:50:58 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.625 14:50:58 -- setup/common.sh@18 -- # local node= 00:03:17.625 14:50:58 -- setup/common.sh@19 -- # local var val 00:03:17.625 14:50:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.625 14:50:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.625 14:50:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.625 14:50:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.625 14:50:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.625 14:50:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101020376 kB' 'MemAvailable: 105322552 kB' 'Buffers: 2696 kB' 'Cached: 18131252 kB' 'SwapCached: 0 kB' 'Active: 15082048 kB' 'Inactive: 3667940 kB' 'Active(anon): 13958104 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 619392 kB' 'Mapped: 204036 kB' 'Shmem: 13342064 kB' 'KReclaimable: 551236 kB' 'Slab: 1421636 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870400 kB' 'KernelStack: 27504 kB' 'PageTables: 9396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15460316 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236328 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.625 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.625 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.626 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.626 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.626 14:50:58 -- setup/common.sh@33 -- # echo 1024 00:03:17.626 14:50:58 -- setup/common.sh@33 -- # return 0 00:03:17.626 14:50:58 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.626 14:50:58 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.626 14:50:58 -- setup/hugepages.sh@27 -- # local node 00:03:17.626 14:50:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.626 14:50:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.626 14:50:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.626 14:50:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.627 14:50:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.627 14:50:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.627 14:50:58 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.627 14:50:58 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.627 14:50:58 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.627 14:50:58 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.627 14:50:58 -- setup/common.sh@18 -- # local node=0 00:03:17.627 14:50:58 -- setup/common.sh@19 -- # local var val 00:03:17.627 14:50:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.627 14:50:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.627 14:50:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.627 14:50:58 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.627 14:50:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.627 14:50:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 53580180 kB' 'MemUsed: 12078828 kB' 'SwapCached: 0 kB' 'Active: 6889124 kB' 'Inactive: 283864 kB' 'Active(anon): 6193196 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100972 kB' 'Mapped: 84656 kB' 'AnonPages: 75088 kB' 'Shmem: 6121180 kB' 'KernelStack: 14200 kB' 'PageTables: 2920 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185276 kB' 'Slab: 677276 kB' 'SReclaimable: 185276 kB' 'SUnreclaim: 492000 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.627 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.627 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.628 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.628 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.628 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.628 14:50:58 -- setup/common.sh@32 -- # continue 00:03:17.628 14:50:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.628 14:50:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.628 14:50:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.628 14:50:58 -- setup/common.sh@33 -- # echo 0 00:03:17.628 14:50:58 -- setup/common.sh@33 -- # return 0 00:03:17.628 14:50:58 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.628 14:50:58 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.628 14:50:58 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.628 14:50:58 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.628 14:50:58 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:17.628 node0=1024 expecting 1024 00:03:17.628 14:50:58 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:17.628 14:50:58 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:17.628 14:50:58 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:17.628 14:50:58 -- setup/hugepages.sh@202 -- # setup output 00:03:17.628 14:50:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.628 14:50:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:20.176 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:03:20.176 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:03:20.176 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:20.441 14:51:01 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:20.441 14:51:01 -- setup/hugepages.sh@89 -- # local node 00:03:20.441 14:51:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.441 14:51:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.441 14:51:01 -- setup/hugepages.sh@92 -- # local surp 00:03:20.441 14:51:01 -- setup/hugepages.sh@93 -- # local resv 00:03:20.441 14:51:01 -- setup/hugepages.sh@94 -- # local anon 00:03:20.441 14:51:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.441 14:51:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.441 14:51:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.441 14:51:01 -- setup/common.sh@18 -- # local node= 00:03:20.441 14:51:01 -- setup/common.sh@19 -- # local var val 00:03:20.441 14:51:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.441 14:51:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.441 14:51:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.441 14:51:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.441 14:51:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.441 14:51:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.441 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.441 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100998516 kB' 'MemAvailable: 105300692 kB' 'Buffers: 2696 kB' 'Cached: 18131372 kB' 'SwapCached: 0 kB' 'Active: 15090300 kB' 'Inactive: 3667940 kB' 'Active(anon): 13966356 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627256 kB' 'Mapped: 204992 kB' 'Shmem: 13342184 kB' 'KReclaimable: 551236 kB' 'Slab: 1421552 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870316 kB' 'KernelStack: 27600 kB' 'PageTables: 9624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15471812 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236220 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.442 14:51:01 -- setup/common.sh@33 -- # echo 0 00:03:20.442 14:51:01 -- setup/common.sh@33 -- # return 0 00:03:20.442 14:51:01 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.442 14:51:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.442 14:51:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.442 14:51:01 -- setup/common.sh@18 -- # local node= 00:03:20.442 14:51:01 -- setup/common.sh@19 -- # local var val 00:03:20.442 14:51:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.442 14:51:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.442 14:51:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.442 14:51:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.442 14:51:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.442 14:51:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.442 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.442 14:51:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 101002988 kB' 'MemAvailable: 105305164 kB' 'Buffers: 2696 kB' 'Cached: 18131376 kB' 'SwapCached: 0 kB' 'Active: 15084160 kB' 'Inactive: 3667940 kB' 'Active(anon): 13960216 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621180 kB' 'Mapped: 204544 kB' 'Shmem: 13342188 kB' 'KReclaimable: 551236 kB' 'Slab: 1421536 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870300 kB' 'KernelStack: 27600 kB' 'PageTables: 9856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15464968 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236216 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:20.442 14:51:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.443 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.443 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.444 14:51:01 -- setup/common.sh@33 -- # echo 0 00:03:20.444 14:51:01 -- setup/common.sh@33 -- # return 0 00:03:20.444 14:51:01 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.444 14:51:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.444 14:51:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.444 14:51:01 -- setup/common.sh@18 -- # local node= 00:03:20.444 14:51:01 -- setup/common.sh@19 -- # local var val 00:03:20.444 14:51:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.444 14:51:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.444 14:51:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.444 14:51:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.444 14:51:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.444 14:51:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100995528 kB' 'MemAvailable: 105297704 kB' 'Buffers: 2696 kB' 'Cached: 18131376 kB' 'SwapCached: 0 kB' 'Active: 15088224 kB' 'Inactive: 3667940 kB' 'Active(anon): 13964280 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 625664 kB' 'Mapped: 204556 kB' 'Shmem: 13342188 kB' 'KReclaimable: 551236 kB' 'Slab: 1421532 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870296 kB' 'KernelStack: 27584 kB' 'PageTables: 9784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15471836 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236200 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.444 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.444 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.445 14:51:01 -- setup/common.sh@33 -- # echo 0 00:03:20.445 14:51:01 -- setup/common.sh@33 -- # return 0 00:03:20.445 14:51:01 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.445 14:51:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:20.445 nr_hugepages=1024 00:03:20.445 14:51:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.445 resv_hugepages=0 00:03:20.445 14:51:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.445 surplus_hugepages=0 00:03:20.445 14:51:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.445 anon_hugepages=0 00:03:20.445 14:51:01 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.445 14:51:01 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:20.445 14:51:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.445 14:51:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.445 14:51:01 -- setup/common.sh@18 -- # local node= 00:03:20.445 14:51:01 -- setup/common.sh@19 -- # local var val 00:03:20.445 14:51:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.445 14:51:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.445 14:51:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.445 14:51:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.445 14:51:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.445 14:51:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 126338904 kB' 'MemFree: 100995632 kB' 'MemAvailable: 105297808 kB' 'Buffers: 2696 kB' 'Cached: 18131416 kB' 'SwapCached: 0 kB' 'Active: 15083556 kB' 'Inactive: 3667940 kB' 'Active(anon): 13959612 kB' 'Inactive(anon): 0 kB' 'Active(file): 1123944 kB' 'Inactive(file): 3667940 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 620960 kB' 'Mapped: 204052 kB' 'Shmem: 13342228 kB' 'KReclaimable: 551236 kB' 'Slab: 1421532 kB' 'SReclaimable: 551236 kB' 'SUnreclaim: 870296 kB' 'KernelStack: 27616 kB' 'PageTables: 9880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 70509480 kB' 'Committed_AS: 15464996 kB' 'VmallocTotal: 13743895347199 kB' 'VmallocUsed: 236184 kB' 'VmallocChunk: 0 kB' 'Percpu: 142848 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 4322676 kB' 'DirectMap2M: 31008768 kB' 'DirectMap1G: 100663296 kB' 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.445 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.445 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.446 14:51:01 -- setup/common.sh@33 -- # echo 1024 00:03:20.446 14:51:01 -- setup/common.sh@33 -- # return 0 00:03:20.446 14:51:01 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.446 14:51:01 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.446 14:51:01 -- setup/hugepages.sh@27 -- # local node 00:03:20.446 14:51:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.446 14:51:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:20.446 14:51:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.446 14:51:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:20.446 14:51:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.446 14:51:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.446 14:51:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.446 14:51:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.446 14:51:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.446 14:51:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.446 14:51:01 -- setup/common.sh@18 -- # local node=0 00:03:20.446 14:51:01 -- setup/common.sh@19 -- # local var val 00:03:20.446 14:51:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.446 14:51:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.446 14:51:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.446 14:51:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.446 14:51:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.446 14:51:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 65659008 kB' 'MemFree: 53565948 kB' 'MemUsed: 12093060 kB' 'SwapCached: 0 kB' 'Active: 6892308 kB' 'Inactive: 283864 kB' 'Active(anon): 6196380 kB' 'Inactive(anon): 0 kB' 'Active(file): 695928 kB' 'Inactive(file): 283864 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7100972 kB' 'Mapped: 84952 kB' 'AnonPages: 78472 kB' 'Shmem: 6121180 kB' 'KernelStack: 14248 kB' 'PageTables: 3144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 185276 kB' 'Slab: 677472 kB' 'SReclaimable: 185276 kB' 'SUnreclaim: 492196 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.446 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.446 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # continue 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.447 14:51:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.447 14:51:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.447 14:51:01 -- setup/common.sh@33 -- # echo 0 00:03:20.447 14:51:01 -- setup/common.sh@33 -- # return 0 00:03:20.447 14:51:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.447 14:51:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.447 14:51:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.447 14:51:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.447 14:51:01 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:20.447 node0=1024 expecting 1024 00:03:20.447 14:51:01 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:20.447 00:03:20.447 real 0m6.090s 00:03:20.447 user 0m2.331s 00:03:20.447 sys 0m3.710s 00:03:20.447 14:51:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:20.447 14:51:01 -- common/autotest_common.sh@10 -- # set +x 00:03:20.447 ************************************ 00:03:20.447 END TEST no_shrink_alloc 00:03:20.447 ************************************ 00:03:20.447 14:51:01 -- setup/hugepages.sh@217 -- # clear_hp 00:03:20.447 14:51:01 -- setup/hugepages.sh@37 -- # local node hp 00:03:20.447 14:51:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:20.447 14:51:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:20.447 14:51:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:20.447 14:51:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:20.447 14:51:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:20.447 14:51:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:20.447 14:51:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:20.447 14:51:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:20.447 14:51:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:20.447 14:51:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:20.447 14:51:01 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:20.447 14:51:01 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:20.447 00:03:20.447 real 0m24.687s 00:03:20.447 user 0m9.679s 00:03:20.447 sys 0m14.988s 00:03:20.447 14:51:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:20.447 14:51:01 -- common/autotest_common.sh@10 -- # set +x 00:03:20.447 ************************************ 00:03:20.447 END TEST hugepages 00:03:20.447 ************************************ 00:03:20.447 14:51:01 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:20.447 14:51:01 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:20.447 14:51:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:20.447 14:51:01 -- common/autotest_common.sh@10 -- # set +x 00:03:20.709 ************************************ 00:03:20.709 START TEST driver 00:03:20.709 ************************************ 00:03:20.709 14:51:01 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:20.709 * Looking for test storage... 00:03:20.709 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:20.709 14:51:01 -- setup/driver.sh@68 -- # setup reset 00:03:20.709 14:51:01 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:20.709 14:51:01 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:26.003 14:51:06 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:26.003 14:51:06 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:26.003 14:51:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:26.003 14:51:06 -- common/autotest_common.sh@10 -- # set +x 00:03:26.003 ************************************ 00:03:26.003 START TEST guess_driver 00:03:26.003 ************************************ 00:03:26.003 14:51:06 -- common/autotest_common.sh@1121 -- # guess_driver 00:03:26.003 14:51:06 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:26.003 14:51:06 -- setup/driver.sh@47 -- # local fail=0 00:03:26.003 14:51:06 -- setup/driver.sh@49 -- # pick_driver 00:03:26.003 14:51:06 -- setup/driver.sh@36 -- # vfio 00:03:26.003 14:51:06 -- setup/driver.sh@21 -- # local iommu_grups 00:03:26.003 14:51:06 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:26.003 14:51:06 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:26.003 14:51:06 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:26.003 14:51:06 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:26.003 14:51:06 -- setup/driver.sh@29 -- # (( 314 > 0 )) 00:03:26.003 14:51:06 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:26.003 14:51:06 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:26.003 14:51:06 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:26.003 14:51:06 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:26.003 14:51:06 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:26.003 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:26.003 14:51:06 -- setup/driver.sh@30 -- # return 0 00:03:26.003 14:51:06 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:26.003 14:51:06 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:26.003 14:51:06 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:26.003 14:51:06 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:26.003 Looking for driver=vfio-pci 00:03:26.003 14:51:06 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.003 14:51:06 -- setup/driver.sh@45 -- # setup output config 00:03:26.003 14:51:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.003 14:51:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.311 14:51:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.311 14:51:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.311 14:51:09 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:29.311 14:51:09 -- setup/driver.sh@65 -- # setup reset 00:03:29.311 14:51:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:29.311 14:51:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:33.522 00:03:33.522 real 0m7.771s 00:03:33.522 user 0m2.468s 00:03:33.522 sys 0m4.469s 00:03:33.522 14:51:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:33.522 14:51:14 -- common/autotest_common.sh@10 -- # set +x 00:03:33.522 ************************************ 00:03:33.522 END TEST guess_driver 00:03:33.522 ************************************ 00:03:33.522 00:03:33.522 real 0m12.684s 00:03:33.522 user 0m3.966s 00:03:33.522 sys 0m7.083s 00:03:33.522 14:51:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:33.522 14:51:14 -- common/autotest_common.sh@10 -- # set +x 00:03:33.522 ************************************ 00:03:33.522 END TEST driver 00:03:33.522 ************************************ 00:03:33.522 14:51:14 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:33.522 14:51:14 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:33.522 14:51:14 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:33.522 14:51:14 -- common/autotest_common.sh@10 -- # set +x 00:03:33.522 ************************************ 00:03:33.522 START TEST devices 00:03:33.522 ************************************ 00:03:33.522 14:51:14 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:33.522 * Looking for test storage... 00:03:33.522 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:33.522 14:51:14 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:33.522 14:51:14 -- setup/devices.sh@192 -- # setup reset 00:03:33.522 14:51:14 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:33.522 14:51:14 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:36.825 14:51:17 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:36.825 14:51:17 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:03:36.825 14:51:17 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:03:36.826 14:51:17 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:03:36.826 14:51:17 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:03:36.826 14:51:17 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:03:36.826 14:51:17 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:03:36.826 14:51:17 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:36.826 14:51:17 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:03:36.826 14:51:17 -- setup/devices.sh@196 -- # blocks=() 00:03:36.826 14:51:17 -- setup/devices.sh@196 -- # declare -a blocks 00:03:36.826 14:51:17 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:36.826 14:51:17 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:36.826 14:51:17 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:36.826 14:51:17 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:36.826 14:51:17 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:36.826 14:51:17 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:36.826 14:51:17 -- setup/devices.sh@202 -- # pci=0000:65:00.0 00:03:36.826 14:51:17 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\6\5\:\0\0\.\0* ]] 00:03:36.826 14:51:17 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:36.826 14:51:17 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:36.826 14:51:17 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:37.086 No valid GPT data, bailing 00:03:37.086 14:51:17 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:37.086 14:51:17 -- scripts/common.sh@391 -- # pt= 00:03:37.086 14:51:17 -- scripts/common.sh@392 -- # return 1 00:03:37.086 14:51:17 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:37.086 14:51:17 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:37.086 14:51:17 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:37.086 14:51:17 -- setup/common.sh@80 -- # echo 1920383410176 00:03:37.086 14:51:17 -- setup/devices.sh@204 -- # (( 1920383410176 >= min_disk_size )) 00:03:37.086 14:51:17 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:37.086 14:51:17 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:65:00.0 00:03:37.086 14:51:17 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:37.086 14:51:17 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:37.086 14:51:17 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:37.086 14:51:17 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:37.086 14:51:17 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:37.086 14:51:17 -- common/autotest_common.sh@10 -- # set +x 00:03:37.086 ************************************ 00:03:37.086 START TEST nvme_mount 00:03:37.086 ************************************ 00:03:37.086 14:51:17 -- common/autotest_common.sh@1121 -- # nvme_mount 00:03:37.086 14:51:17 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:37.086 14:51:17 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:37.086 14:51:17 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.086 14:51:17 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.086 14:51:17 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:37.086 14:51:17 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:37.086 14:51:17 -- setup/common.sh@40 -- # local part_no=1 00:03:37.086 14:51:17 -- setup/common.sh@41 -- # local size=1073741824 00:03:37.086 14:51:17 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:37.086 14:51:17 -- setup/common.sh@44 -- # parts=() 00:03:37.086 14:51:17 -- setup/common.sh@44 -- # local parts 00:03:37.086 14:51:17 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:37.086 14:51:17 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:37.086 14:51:17 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:37.086 14:51:17 -- setup/common.sh@46 -- # (( part++ )) 00:03:37.086 14:51:17 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:37.086 14:51:17 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:37.086 14:51:17 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:37.086 14:51:17 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:38.471 Creating new GPT entries in memory. 00:03:38.471 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:38.471 other utilities. 00:03:38.471 14:51:18 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:38.471 14:51:18 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:38.471 14:51:18 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:38.471 14:51:18 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:38.471 14:51:18 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:39.412 Creating new GPT entries in memory. 00:03:39.412 The operation has completed successfully. 00:03:39.412 14:51:19 -- setup/common.sh@57 -- # (( part++ )) 00:03:39.412 14:51:19 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:39.412 14:51:19 -- setup/common.sh@62 -- # wait 3287024 00:03:39.412 14:51:20 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.412 14:51:20 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:39.412 14:51:20 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.412 14:51:20 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:39.412 14:51:20 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:39.412 14:51:20 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.412 14:51:20 -- setup/devices.sh@105 -- # verify 0000:65:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.412 14:51:20 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:39.412 14:51:20 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:39.412 14:51:20 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.412 14:51:20 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.412 14:51:20 -- setup/devices.sh@53 -- # local found=0 00:03:39.412 14:51:20 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:39.412 14:51:20 -- setup/devices.sh@56 -- # : 00:03:39.412 14:51:20 -- setup/devices.sh@59 -- # local pci status 00:03:39.412 14:51:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.412 14:51:20 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:39.412 14:51:20 -- setup/devices.sh@47 -- # setup output config 00:03:39.412 14:51:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.412 14:51:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:42.811 14:51:23 -- setup/devices.sh@63 -- # found=1 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.811 14:51:23 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:42.811 14:51:23 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.811 14:51:23 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.811 14:51:23 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:42.811 14:51:23 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:42.811 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:42.811 14:51:23 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:42.811 14:51:23 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:42.811 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:42.811 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:03:42.811 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:42.811 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:42.811 14:51:23 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:42.811 14:51:23 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:42.811 14:51:23 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:42.811 14:51:23 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:42.811 14:51:23 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/devices.sh@116 -- # verify 0000:65:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.811 14:51:23 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:42.811 14:51:23 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:42.811 14:51:23 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.811 14:51:23 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.811 14:51:23 -- setup/devices.sh@53 -- # local found=0 00:03:42.811 14:51:23 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:42.811 14:51:23 -- setup/devices.sh@56 -- # : 00:03:42.811 14:51:23 -- setup/devices.sh@59 -- # local pci status 00:03:42.811 14:51:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.811 14:51:23 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:42.811 14:51:23 -- setup/devices.sh@47 -- # setup output config 00:03:42.811 14:51:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.811 14:51:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:46.117 14:51:26 -- setup/devices.sh@63 -- # found=1 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:51:26 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:46.117 14:51:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.378 14:51:27 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.378 14:51:27 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:46.378 14:51:27 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.378 14:51:27 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.378 14:51:27 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.378 14:51:27 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.378 14:51:27 -- setup/devices.sh@125 -- # verify 0000:65:00.0 data@nvme0n1 '' '' 00:03:46.378 14:51:27 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:46.378 14:51:27 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:46.378 14:51:27 -- setup/devices.sh@50 -- # local mount_point= 00:03:46.378 14:51:27 -- setup/devices.sh@51 -- # local test_file= 00:03:46.378 14:51:27 -- setup/devices.sh@53 -- # local found=0 00:03:46.378 14:51:27 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:46.378 14:51:27 -- setup/devices.sh@59 -- # local pci status 00:03:46.378 14:51:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.378 14:51:27 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:46.378 14:51:27 -- setup/devices.sh@47 -- # setup output config 00:03:46.378 14:51:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.378 14:51:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:49.680 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.680 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.680 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.680 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:49.681 14:51:30 -- setup/devices.sh@63 -- # found=1 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.681 14:51:30 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:49.681 14:51:30 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:49.681 14:51:30 -- setup/devices.sh@68 -- # return 0 00:03:49.681 14:51:30 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:49.681 14:51:30 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.681 14:51:30 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:49.681 14:51:30 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:49.681 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:49.681 00:03:49.681 real 0m12.482s 00:03:49.681 user 0m3.912s 00:03:49.681 sys 0m6.435s 00:03:49.681 14:51:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:49.681 14:51:30 -- common/autotest_common.sh@10 -- # set +x 00:03:49.681 ************************************ 00:03:49.681 END TEST nvme_mount 00:03:49.681 ************************************ 00:03:49.681 14:51:30 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:49.681 14:51:30 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:49.681 14:51:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:49.681 14:51:30 -- common/autotest_common.sh@10 -- # set +x 00:03:49.941 ************************************ 00:03:49.941 START TEST dm_mount 00:03:49.941 ************************************ 00:03:49.941 14:51:30 -- common/autotest_common.sh@1121 -- # dm_mount 00:03:49.941 14:51:30 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:49.941 14:51:30 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:49.941 14:51:30 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:49.941 14:51:30 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:49.941 14:51:30 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:49.941 14:51:30 -- setup/common.sh@40 -- # local part_no=2 00:03:49.941 14:51:30 -- setup/common.sh@41 -- # local size=1073741824 00:03:49.941 14:51:30 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:49.941 14:51:30 -- setup/common.sh@44 -- # parts=() 00:03:49.941 14:51:30 -- setup/common.sh@44 -- # local parts 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.941 14:51:30 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part++ )) 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.941 14:51:30 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part++ )) 00:03:49.941 14:51:30 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.941 14:51:30 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:49.941 14:51:30 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:49.941 14:51:30 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:50.884 Creating new GPT entries in memory. 00:03:50.884 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:50.884 other utilities. 00:03:50.884 14:51:31 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:50.884 14:51:31 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:50.884 14:51:31 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:50.884 14:51:31 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:50.884 14:51:31 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:51.826 Creating new GPT entries in memory. 00:03:51.826 The operation has completed successfully. 00:03:51.826 14:51:32 -- setup/common.sh@57 -- # (( part++ )) 00:03:51.826 14:51:32 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:51.826 14:51:32 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:51.826 14:51:32 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:51.826 14:51:32 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:52.769 The operation has completed successfully. 00:03:52.769 14:51:33 -- setup/common.sh@57 -- # (( part++ )) 00:03:52.769 14:51:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:52.769 14:51:33 -- setup/common.sh@62 -- # wait 3291891 00:03:53.030 14:51:33 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:53.030 14:51:33 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:53.030 14:51:33 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:53.030 14:51:33 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:53.030 14:51:33 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:53.030 14:51:33 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:53.030 14:51:33 -- setup/devices.sh@161 -- # break 00:03:53.030 14:51:33 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:53.030 14:51:33 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:53.030 14:51:33 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:53.030 14:51:33 -- setup/devices.sh@166 -- # dm=dm-0 00:03:53.030 14:51:33 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:53.030 14:51:33 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:53.030 14:51:33 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:53.030 14:51:33 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:03:53.030 14:51:33 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:53.030 14:51:33 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:53.030 14:51:33 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:53.030 14:51:33 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:53.030 14:51:33 -- setup/devices.sh@174 -- # verify 0000:65:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:53.030 14:51:33 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:53.030 14:51:33 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:53.030 14:51:33 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:53.030 14:51:33 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:53.030 14:51:33 -- setup/devices.sh@53 -- # local found=0 00:03:53.030 14:51:33 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:53.030 14:51:33 -- setup/devices.sh@56 -- # : 00:03:53.030 14:51:33 -- setup/devices.sh@59 -- # local pci status 00:03:53.030 14:51:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.030 14:51:33 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:53.030 14:51:33 -- setup/devices.sh@47 -- # setup output config 00:03:53.030 14:51:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:53.030 14:51:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:56.334 14:51:36 -- setup/devices.sh@63 -- # found=1 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:36 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:56.334 14:51:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:56.334 14:51:37 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:56.334 14:51:37 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:56.334 14:51:37 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:56.334 14:51:37 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:56.334 14:51:37 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:56.334 14:51:37 -- setup/devices.sh@184 -- # verify 0000:65:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:56.334 14:51:37 -- setup/devices.sh@48 -- # local dev=0000:65:00.0 00:03:56.334 14:51:37 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:56.334 14:51:37 -- setup/devices.sh@50 -- # local mount_point= 00:03:56.334 14:51:37 -- setup/devices.sh@51 -- # local test_file= 00:03:56.334 14:51:37 -- setup/devices.sh@53 -- # local found=0 00:03:56.334 14:51:37 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:56.334 14:51:37 -- setup/devices.sh@59 -- # local pci status 00:03:56.334 14:51:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:56.334 14:51:37 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:65:00.0 00:03:56.334 14:51:37 -- setup/devices.sh@47 -- # setup output config 00:03:56.334 14:51:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:56.334 14:51:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:59.639 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.639 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.639 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.639 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.639 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.639 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.639 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.639 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.639 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.639 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:80:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:65:00.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:59.640 14:51:40 -- setup/devices.sh@63 -- # found=1 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.6 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.7 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.4 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.5 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.2 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.3 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.0 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@62 -- # [[ 0000:00:01.1 == \0\0\0\0\:\6\5\:\0\0\.\0 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.640 14:51:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:59.640 14:51:40 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:59.640 14:51:40 -- setup/devices.sh@68 -- # return 0 00:03:59.640 14:51:40 -- setup/devices.sh@187 -- # cleanup_dm 00:03:59.640 14:51:40 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:59.640 14:51:40 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:59.640 14:51:40 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:59.640 14:51:40 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:59.640 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:59.640 14:51:40 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:59.640 00:03:59.640 real 0m9.863s 00:03:59.640 user 0m2.609s 00:03:59.640 sys 0m4.321s 00:03:59.640 14:51:40 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:59.640 14:51:40 -- common/autotest_common.sh@10 -- # set +x 00:03:59.640 ************************************ 00:03:59.640 END TEST dm_mount 00:03:59.640 ************************************ 00:03:59.640 14:51:40 -- setup/devices.sh@1 -- # cleanup 00:03:59.640 14:51:40 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:59.640 14:51:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:59.640 14:51:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:59.640 14:51:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:59.640 14:51:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:59.901 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:59.901 /dev/nvme0n1: 8 bytes were erased at offset 0x1bf1fc55e00 (gpt): 45 46 49 20 50 41 52 54 00:03:59.901 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:59.901 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:59.901 14:51:40 -- setup/devices.sh@12 -- # cleanup_dm 00:03:59.901 14:51:40 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:59.901 14:51:40 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:59.901 14:51:40 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:59.901 14:51:40 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:59.901 14:51:40 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:59.901 14:51:40 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:59.901 00:03:59.901 real 0m26.455s 00:03:59.901 user 0m7.841s 00:03:59.901 sys 0m13.330s 00:03:59.901 14:51:40 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:59.901 14:51:40 -- common/autotest_common.sh@10 -- # set +x 00:03:59.901 ************************************ 00:03:59.901 END TEST devices 00:03:59.901 ************************************ 00:03:59.901 00:03:59.901 real 1m29.029s 00:03:59.901 user 0m29.815s 00:03:59.901 sys 0m50.029s 00:03:59.901 14:51:40 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:59.901 14:51:40 -- common/autotest_common.sh@10 -- # set +x 00:03:59.901 ************************************ 00:03:59.901 END TEST setup.sh 00:03:59.901 ************************************ 00:04:00.163 14:51:40 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:04:03.466 Hugepages 00:04:03.466 node hugesize free / total 00:04:03.466 node0 1048576kB 0 / 0 00:04:03.466 node0 2048kB 2048 / 2048 00:04:03.466 node1 1048576kB 0 / 0 00:04:03.466 node1 2048kB 0 / 0 00:04:03.466 00:04:03.466 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:03.466 I/OAT 0000:00:01.0 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.1 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.2 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.3 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.4 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.5 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.6 8086 0b00 0 ioatdma - - 00:04:03.466 I/OAT 0000:00:01.7 8086 0b00 0 ioatdma - - 00:04:03.466 NVMe 0000:65:00.0 144d a80a 0 nvme nvme0 nvme0n1 00:04:03.466 I/OAT 0000:80:01.0 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.1 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.2 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.3 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.4 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.5 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.6 8086 0b00 1 ioatdma - - 00:04:03.466 I/OAT 0000:80:01.7 8086 0b00 1 ioatdma - - 00:04:03.466 14:51:44 -- spdk/autotest.sh@130 -- # uname -s 00:04:03.466 14:51:44 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:04:03.466 14:51:44 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:04:03.466 14:51:44 -- common/autotest_common.sh@1527 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:06.769 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:06.769 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:08.681 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:04:08.681 14:51:49 -- common/autotest_common.sh@1528 -- # sleep 1 00:04:10.064 14:51:50 -- common/autotest_common.sh@1529 -- # bdfs=() 00:04:10.064 14:51:50 -- common/autotest_common.sh@1529 -- # local bdfs 00:04:10.064 14:51:50 -- common/autotest_common.sh@1530 -- # bdfs=($(get_nvme_bdfs)) 00:04:10.064 14:51:50 -- common/autotest_common.sh@1530 -- # get_nvme_bdfs 00:04:10.064 14:51:50 -- common/autotest_common.sh@1509 -- # bdfs=() 00:04:10.064 14:51:50 -- common/autotest_common.sh@1509 -- # local bdfs 00:04:10.064 14:51:50 -- common/autotest_common.sh@1510 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:10.064 14:51:50 -- common/autotest_common.sh@1510 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:10.064 14:51:50 -- common/autotest_common.sh@1510 -- # jq -r '.config[].params.traddr' 00:04:10.064 14:51:50 -- common/autotest_common.sh@1511 -- # (( 1 == 0 )) 00:04:10.064 14:51:50 -- common/autotest_common.sh@1515 -- # printf '%s\n' 0000:65:00.0 00:04:10.064 14:51:50 -- common/autotest_common.sh@1532 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:13.369 Waiting for block devices as requested 00:04:13.369 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:04:13.369 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:04:13.369 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:04:13.369 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:04:13.369 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:04:13.369 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:04:13.630 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:04:13.630 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:04:13.630 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:04:13.890 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:04:13.890 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:04:13.890 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:04:14.151 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:04:14.151 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:04:14.151 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:04:14.151 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:04:14.412 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:04:14.412 14:51:55 -- common/autotest_common.sh@1534 -- # for bdf in "${bdfs[@]}" 00:04:14.412 14:51:55 -- common/autotest_common.sh@1535 -- # get_nvme_ctrlr_from_bdf 0000:65:00.0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1498 -- # readlink -f /sys/class/nvme/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1498 -- # grep 0000:65:00.0/nvme/nvme 00:04:14.412 14:51:55 -- common/autotest_common.sh@1498 -- # bdf_sysfs_path=/sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1499 -- # [[ -z /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 ]] 00:04:14.412 14:51:55 -- common/autotest_common.sh@1503 -- # basename /sys/devices/pci0000:64/0000:64:02.0/0000:65:00.0/nvme/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1503 -- # printf '%s\n' nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1535 -- # nvme_ctrlr=/dev/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1536 -- # [[ -z /dev/nvme0 ]] 00:04:14.412 14:51:55 -- common/autotest_common.sh@1541 -- # nvme id-ctrl /dev/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1541 -- # grep oacs 00:04:14.412 14:51:55 -- common/autotest_common.sh@1541 -- # cut -d: -f2 00:04:14.412 14:51:55 -- common/autotest_common.sh@1541 -- # oacs=' 0x5f' 00:04:14.412 14:51:55 -- common/autotest_common.sh@1542 -- # oacs_ns_manage=8 00:04:14.412 14:51:55 -- common/autotest_common.sh@1544 -- # [[ 8 -ne 0 ]] 00:04:14.412 14:51:55 -- common/autotest_common.sh@1550 -- # nvme id-ctrl /dev/nvme0 00:04:14.412 14:51:55 -- common/autotest_common.sh@1550 -- # grep unvmcap 00:04:14.412 14:51:55 -- common/autotest_common.sh@1550 -- # cut -d: -f2 00:04:14.412 14:51:55 -- common/autotest_common.sh@1550 -- # unvmcap=' 0' 00:04:14.412 14:51:55 -- common/autotest_common.sh@1551 -- # [[ 0 -eq 0 ]] 00:04:14.412 14:51:55 -- common/autotest_common.sh@1553 -- # continue 00:04:14.412 14:51:55 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:04:14.412 14:51:55 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:14.412 14:51:55 -- common/autotest_common.sh@10 -- # set +x 00:04:14.412 14:51:55 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:04:14.412 14:51:55 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:14.412 14:51:55 -- common/autotest_common.sh@10 -- # set +x 00:04:14.412 14:51:55 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:17.738 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:04:17.738 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:04:17.738 14:51:58 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:04:17.738 14:51:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:17.738 14:51:58 -- common/autotest_common.sh@10 -- # set +x 00:04:17.738 14:51:58 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:04:17.738 14:51:58 -- common/autotest_common.sh@1587 -- # mapfile -t bdfs 00:04:17.738 14:51:58 -- common/autotest_common.sh@1587 -- # get_nvme_bdfs_by_id 0x0a54 00:04:17.738 14:51:58 -- common/autotest_common.sh@1573 -- # bdfs=() 00:04:17.738 14:51:58 -- common/autotest_common.sh@1573 -- # local bdfs 00:04:17.738 14:51:58 -- common/autotest_common.sh@1575 -- # get_nvme_bdfs 00:04:17.738 14:51:58 -- common/autotest_common.sh@1509 -- # bdfs=() 00:04:17.738 14:51:58 -- common/autotest_common.sh@1509 -- # local bdfs 00:04:17.738 14:51:58 -- common/autotest_common.sh@1510 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:17.999 14:51:58 -- common/autotest_common.sh@1510 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:17.999 14:51:58 -- common/autotest_common.sh@1510 -- # jq -r '.config[].params.traddr' 00:04:17.999 14:51:58 -- common/autotest_common.sh@1511 -- # (( 1 == 0 )) 00:04:17.999 14:51:58 -- common/autotest_common.sh@1515 -- # printf '%s\n' 0000:65:00.0 00:04:17.999 14:51:58 -- common/autotest_common.sh@1575 -- # for bdf in $(get_nvme_bdfs) 00:04:17.999 14:51:58 -- common/autotest_common.sh@1576 -- # cat /sys/bus/pci/devices/0000:65:00.0/device 00:04:17.999 14:51:58 -- common/autotest_common.sh@1576 -- # device=0xa80a 00:04:17.999 14:51:58 -- common/autotest_common.sh@1577 -- # [[ 0xa80a == \0\x\0\a\5\4 ]] 00:04:17.999 14:51:58 -- common/autotest_common.sh@1582 -- # printf '%s\n' 00:04:17.999 14:51:58 -- common/autotest_common.sh@1588 -- # [[ -z '' ]] 00:04:17.999 14:51:58 -- common/autotest_common.sh@1589 -- # return 0 00:04:17.999 14:51:58 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:17.999 14:51:58 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:17.999 14:51:58 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:17.999 14:51:58 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:17.999 14:51:58 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:17.999 14:51:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:17.999 14:51:58 -- common/autotest_common.sh@10 -- # set +x 00:04:17.999 14:51:58 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:17.999 14:51:58 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:17.999 14:51:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:17.999 14:51:58 -- common/autotest_common.sh@10 -- # set +x 00:04:17.999 ************************************ 00:04:17.999 START TEST env 00:04:17.999 ************************************ 00:04:17.999 14:51:58 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:18.260 * Looking for test storage... 00:04:18.260 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:04:18.260 14:51:59 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:18.260 14:51:59 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:18.260 14:51:59 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:18.260 14:51:59 -- common/autotest_common.sh@10 -- # set +x 00:04:18.260 ************************************ 00:04:18.260 START TEST env_memory 00:04:18.260 ************************************ 00:04:18.260 14:51:59 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:18.260 00:04:18.260 00:04:18.260 CUnit - A unit testing framework for C - Version 2.1-3 00:04:18.260 http://cunit.sourceforge.net/ 00:04:18.260 00:04:18.260 00:04:18.260 Suite: memory 00:04:18.521 Test: alloc and free memory map ...[2024-04-26 14:51:59.246159] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:18.521 passed 00:04:18.521 Test: mem map translation ...[2024-04-26 14:51:59.271739] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:18.521 [2024-04-26 14:51:59.271768] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:18.521 [2024-04-26 14:51:59.271816] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:18.521 [2024-04-26 14:51:59.271824] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:18.521 passed 00:04:18.521 Test: mem map registration ...[2024-04-26 14:51:59.326930] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:18.521 [2024-04-26 14:51:59.326950] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:18.521 passed 00:04:18.521 Test: mem map adjacent registrations ...passed 00:04:18.521 00:04:18.521 Run Summary: Type Total Ran Passed Failed Inactive 00:04:18.521 suites 1 1 n/a 0 0 00:04:18.521 tests 4 4 4 0 0 00:04:18.521 asserts 152 152 152 0 n/a 00:04:18.521 00:04:18.521 Elapsed time = 0.194 seconds 00:04:18.521 00:04:18.521 real 0m0.207s 00:04:18.521 user 0m0.194s 00:04:18.521 sys 0m0.012s 00:04:18.521 14:51:59 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:18.521 14:51:59 -- common/autotest_common.sh@10 -- # set +x 00:04:18.521 ************************************ 00:04:18.521 END TEST env_memory 00:04:18.521 ************************************ 00:04:18.521 14:51:59 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:18.521 14:51:59 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:18.521 14:51:59 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:18.521 14:51:59 -- common/autotest_common.sh@10 -- # set +x 00:04:18.784 ************************************ 00:04:18.784 START TEST env_vtophys 00:04:18.784 ************************************ 00:04:18.784 14:51:59 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:18.784 EAL: lib.eal log level changed from notice to debug 00:04:18.784 EAL: Detected lcore 0 as core 0 on socket 0 00:04:18.784 EAL: Detected lcore 1 as core 1 on socket 0 00:04:18.784 EAL: Detected lcore 2 as core 2 on socket 0 00:04:18.784 EAL: Detected lcore 3 as core 3 on socket 0 00:04:18.784 EAL: Detected lcore 4 as core 4 on socket 0 00:04:18.784 EAL: Detected lcore 5 as core 5 on socket 0 00:04:18.784 EAL: Detected lcore 6 as core 6 on socket 0 00:04:18.784 EAL: Detected lcore 7 as core 7 on socket 0 00:04:18.784 EAL: Detected lcore 8 as core 8 on socket 0 00:04:18.784 EAL: Detected lcore 9 as core 9 on socket 0 00:04:18.784 EAL: Detected lcore 10 as core 10 on socket 0 00:04:18.784 EAL: Detected lcore 11 as core 11 on socket 0 00:04:18.784 EAL: Detected lcore 12 as core 12 on socket 0 00:04:18.784 EAL: Detected lcore 13 as core 13 on socket 0 00:04:18.784 EAL: Detected lcore 14 as core 14 on socket 0 00:04:18.784 EAL: Detected lcore 15 as core 15 on socket 0 00:04:18.784 EAL: Detected lcore 16 as core 16 on socket 0 00:04:18.784 EAL: Detected lcore 17 as core 17 on socket 0 00:04:18.784 EAL: Detected lcore 18 as core 18 on socket 0 00:04:18.784 EAL: Detected lcore 19 as core 19 on socket 0 00:04:18.784 EAL: Detected lcore 20 as core 20 on socket 0 00:04:18.784 EAL: Detected lcore 21 as core 21 on socket 0 00:04:18.784 EAL: Detected lcore 22 as core 22 on socket 0 00:04:18.784 EAL: Detected lcore 23 as core 23 on socket 0 00:04:18.784 EAL: Detected lcore 24 as core 24 on socket 0 00:04:18.784 EAL: Detected lcore 25 as core 25 on socket 0 00:04:18.784 EAL: Detected lcore 26 as core 26 on socket 0 00:04:18.784 EAL: Detected lcore 27 as core 27 on socket 0 00:04:18.784 EAL: Detected lcore 28 as core 28 on socket 0 00:04:18.784 EAL: Detected lcore 29 as core 29 on socket 0 00:04:18.784 EAL: Detected lcore 30 as core 30 on socket 0 00:04:18.784 EAL: Detected lcore 31 as core 31 on socket 0 00:04:18.784 EAL: Detected lcore 32 as core 32 on socket 0 00:04:18.784 EAL: Detected lcore 33 as core 33 on socket 0 00:04:18.784 EAL: Detected lcore 34 as core 34 on socket 0 00:04:18.784 EAL: Detected lcore 35 as core 35 on socket 0 00:04:18.784 EAL: Detected lcore 36 as core 0 on socket 1 00:04:18.784 EAL: Detected lcore 37 as core 1 on socket 1 00:04:18.784 EAL: Detected lcore 38 as core 2 on socket 1 00:04:18.784 EAL: Detected lcore 39 as core 3 on socket 1 00:04:18.784 EAL: Detected lcore 40 as core 4 on socket 1 00:04:18.784 EAL: Detected lcore 41 as core 5 on socket 1 00:04:18.784 EAL: Detected lcore 42 as core 6 on socket 1 00:04:18.784 EAL: Detected lcore 43 as core 7 on socket 1 00:04:18.784 EAL: Detected lcore 44 as core 8 on socket 1 00:04:18.784 EAL: Detected lcore 45 as core 9 on socket 1 00:04:18.784 EAL: Detected lcore 46 as core 10 on socket 1 00:04:18.784 EAL: Detected lcore 47 as core 11 on socket 1 00:04:18.784 EAL: Detected lcore 48 as core 12 on socket 1 00:04:18.784 EAL: Detected lcore 49 as core 13 on socket 1 00:04:18.784 EAL: Detected lcore 50 as core 14 on socket 1 00:04:18.784 EAL: Detected lcore 51 as core 15 on socket 1 00:04:18.784 EAL: Detected lcore 52 as core 16 on socket 1 00:04:18.784 EAL: Detected lcore 53 as core 17 on socket 1 00:04:18.784 EAL: Detected lcore 54 as core 18 on socket 1 00:04:18.784 EAL: Detected lcore 55 as core 19 on socket 1 00:04:18.784 EAL: Detected lcore 56 as core 20 on socket 1 00:04:18.784 EAL: Detected lcore 57 as core 21 on socket 1 00:04:18.784 EAL: Detected lcore 58 as core 22 on socket 1 00:04:18.784 EAL: Detected lcore 59 as core 23 on socket 1 00:04:18.784 EAL: Detected lcore 60 as core 24 on socket 1 00:04:18.784 EAL: Detected lcore 61 as core 25 on socket 1 00:04:18.784 EAL: Detected lcore 62 as core 26 on socket 1 00:04:18.784 EAL: Detected lcore 63 as core 27 on socket 1 00:04:18.784 EAL: Detected lcore 64 as core 28 on socket 1 00:04:18.784 EAL: Detected lcore 65 as core 29 on socket 1 00:04:18.784 EAL: Detected lcore 66 as core 30 on socket 1 00:04:18.784 EAL: Detected lcore 67 as core 31 on socket 1 00:04:18.784 EAL: Detected lcore 68 as core 32 on socket 1 00:04:18.784 EAL: Detected lcore 69 as core 33 on socket 1 00:04:18.784 EAL: Detected lcore 70 as core 34 on socket 1 00:04:18.784 EAL: Detected lcore 71 as core 35 on socket 1 00:04:18.784 EAL: Detected lcore 72 as core 0 on socket 0 00:04:18.784 EAL: Detected lcore 73 as core 1 on socket 0 00:04:18.784 EAL: Detected lcore 74 as core 2 on socket 0 00:04:18.784 EAL: Detected lcore 75 as core 3 on socket 0 00:04:18.784 EAL: Detected lcore 76 as core 4 on socket 0 00:04:18.784 EAL: Detected lcore 77 as core 5 on socket 0 00:04:18.784 EAL: Detected lcore 78 as core 6 on socket 0 00:04:18.784 EAL: Detected lcore 79 as core 7 on socket 0 00:04:18.784 EAL: Detected lcore 80 as core 8 on socket 0 00:04:18.784 EAL: Detected lcore 81 as core 9 on socket 0 00:04:18.784 EAL: Detected lcore 82 as core 10 on socket 0 00:04:18.784 EAL: Detected lcore 83 as core 11 on socket 0 00:04:18.784 EAL: Detected lcore 84 as core 12 on socket 0 00:04:18.784 EAL: Detected lcore 85 as core 13 on socket 0 00:04:18.784 EAL: Detected lcore 86 as core 14 on socket 0 00:04:18.784 EAL: Detected lcore 87 as core 15 on socket 0 00:04:18.784 EAL: Detected lcore 88 as core 16 on socket 0 00:04:18.784 EAL: Detected lcore 89 as core 17 on socket 0 00:04:18.784 EAL: Detected lcore 90 as core 18 on socket 0 00:04:18.784 EAL: Detected lcore 91 as core 19 on socket 0 00:04:18.784 EAL: Detected lcore 92 as core 20 on socket 0 00:04:18.785 EAL: Detected lcore 93 as core 21 on socket 0 00:04:18.785 EAL: Detected lcore 94 as core 22 on socket 0 00:04:18.785 EAL: Detected lcore 95 as core 23 on socket 0 00:04:18.785 EAL: Detected lcore 96 as core 24 on socket 0 00:04:18.785 EAL: Detected lcore 97 as core 25 on socket 0 00:04:18.785 EAL: Detected lcore 98 as core 26 on socket 0 00:04:18.785 EAL: Detected lcore 99 as core 27 on socket 0 00:04:18.785 EAL: Detected lcore 100 as core 28 on socket 0 00:04:18.785 EAL: Detected lcore 101 as core 29 on socket 0 00:04:18.785 EAL: Detected lcore 102 as core 30 on socket 0 00:04:18.785 EAL: Detected lcore 103 as core 31 on socket 0 00:04:18.785 EAL: Detected lcore 104 as core 32 on socket 0 00:04:18.785 EAL: Detected lcore 105 as core 33 on socket 0 00:04:18.785 EAL: Detected lcore 106 as core 34 on socket 0 00:04:18.785 EAL: Detected lcore 107 as core 35 on socket 0 00:04:18.785 EAL: Detected lcore 108 as core 0 on socket 1 00:04:18.785 EAL: Detected lcore 109 as core 1 on socket 1 00:04:18.785 EAL: Detected lcore 110 as core 2 on socket 1 00:04:18.785 EAL: Detected lcore 111 as core 3 on socket 1 00:04:18.785 EAL: Detected lcore 112 as core 4 on socket 1 00:04:18.785 EAL: Detected lcore 113 as core 5 on socket 1 00:04:18.785 EAL: Detected lcore 114 as core 6 on socket 1 00:04:18.785 EAL: Detected lcore 115 as core 7 on socket 1 00:04:18.785 EAL: Detected lcore 116 as core 8 on socket 1 00:04:18.785 EAL: Detected lcore 117 as core 9 on socket 1 00:04:18.785 EAL: Detected lcore 118 as core 10 on socket 1 00:04:18.785 EAL: Detected lcore 119 as core 11 on socket 1 00:04:18.785 EAL: Detected lcore 120 as core 12 on socket 1 00:04:18.785 EAL: Detected lcore 121 as core 13 on socket 1 00:04:18.785 EAL: Detected lcore 122 as core 14 on socket 1 00:04:18.785 EAL: Detected lcore 123 as core 15 on socket 1 00:04:18.785 EAL: Detected lcore 124 as core 16 on socket 1 00:04:18.785 EAL: Detected lcore 125 as core 17 on socket 1 00:04:18.785 EAL: Detected lcore 126 as core 18 on socket 1 00:04:18.785 EAL: Detected lcore 127 as core 19 on socket 1 00:04:18.785 EAL: Skipped lcore 128 as core 20 on socket 1 00:04:18.785 EAL: Skipped lcore 129 as core 21 on socket 1 00:04:18.785 EAL: Skipped lcore 130 as core 22 on socket 1 00:04:18.785 EAL: Skipped lcore 131 as core 23 on socket 1 00:04:18.785 EAL: Skipped lcore 132 as core 24 on socket 1 00:04:18.785 EAL: Skipped lcore 133 as core 25 on socket 1 00:04:18.785 EAL: Skipped lcore 134 as core 26 on socket 1 00:04:18.785 EAL: Skipped lcore 135 as core 27 on socket 1 00:04:18.785 EAL: Skipped lcore 136 as core 28 on socket 1 00:04:18.785 EAL: Skipped lcore 137 as core 29 on socket 1 00:04:18.785 EAL: Skipped lcore 138 as core 30 on socket 1 00:04:18.785 EAL: Skipped lcore 139 as core 31 on socket 1 00:04:18.785 EAL: Skipped lcore 140 as core 32 on socket 1 00:04:18.785 EAL: Skipped lcore 141 as core 33 on socket 1 00:04:18.785 EAL: Skipped lcore 142 as core 34 on socket 1 00:04:18.785 EAL: Skipped lcore 143 as core 35 on socket 1 00:04:18.785 EAL: Maximum logical cores by configuration: 128 00:04:18.785 EAL: Detected CPU lcores: 128 00:04:18.785 EAL: Detected NUMA nodes: 2 00:04:18.785 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:18.785 EAL: Detected shared linkage of DPDK 00:04:18.785 EAL: No shared files mode enabled, IPC will be disabled 00:04:18.785 EAL: Bus pci wants IOVA as 'DC' 00:04:18.785 EAL: Buses did not request a specific IOVA mode. 00:04:18.785 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:18.785 EAL: Selected IOVA mode 'VA' 00:04:18.785 EAL: No free 2048 kB hugepages reported on node 1 00:04:18.785 EAL: Probing VFIO support... 00:04:18.785 EAL: IOMMU type 1 (Type 1) is supported 00:04:18.785 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:18.785 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:18.785 EAL: VFIO support initialized 00:04:18.785 EAL: Ask a virtual area of 0x2e000 bytes 00:04:18.785 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:18.785 EAL: Setting up physically contiguous memory... 00:04:18.785 EAL: Setting maximum number of open files to 524288 00:04:18.785 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:18.785 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:18.785 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:18.785 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:18.785 EAL: Ask a virtual area of 0x61000 bytes 00:04:18.785 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:18.785 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:18.785 EAL: Ask a virtual area of 0x400000000 bytes 00:04:18.785 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:18.785 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:18.785 EAL: Hugepages will be freed exactly as allocated. 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: TSC frequency is ~2400000 KHz 00:04:18.785 EAL: Main lcore 0 is ready (tid=7fc30b9cba00;cpuset=[0]) 00:04:18.785 EAL: Trying to obtain current memory policy. 00:04:18.785 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.785 EAL: Restoring previous memory policy: 0 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was expanded by 2MB 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:18.785 EAL: Mem event callback 'spdk:(nil)' registered 00:04:18.785 00:04:18.785 00:04:18.785 CUnit - A unit testing framework for C - Version 2.1-3 00:04:18.785 http://cunit.sourceforge.net/ 00:04:18.785 00:04:18.785 00:04:18.785 Suite: components_suite 00:04:18.785 Test: vtophys_malloc_test ...passed 00:04:18.785 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:18.785 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.785 EAL: Restoring previous memory policy: 4 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was expanded by 4MB 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was shrunk by 4MB 00:04:18.785 EAL: Trying to obtain current memory policy. 00:04:18.785 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.785 EAL: Restoring previous memory policy: 4 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was expanded by 6MB 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was shrunk by 6MB 00:04:18.785 EAL: Trying to obtain current memory policy. 00:04:18.785 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.785 EAL: Restoring previous memory policy: 4 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was expanded by 10MB 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was shrunk by 10MB 00:04:18.785 EAL: Trying to obtain current memory policy. 00:04:18.785 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.785 EAL: Restoring previous memory policy: 4 00:04:18.785 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.785 EAL: request: mp_malloc_sync 00:04:18.785 EAL: No shared files mode enabled, IPC is disabled 00:04:18.785 EAL: Heap on socket 0 was expanded by 18MB 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was shrunk by 18MB 00:04:18.786 EAL: Trying to obtain current memory policy. 00:04:18.786 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.786 EAL: Restoring previous memory policy: 4 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was expanded by 34MB 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was shrunk by 34MB 00:04:18.786 EAL: Trying to obtain current memory policy. 00:04:18.786 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.786 EAL: Restoring previous memory policy: 4 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was expanded by 66MB 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was shrunk by 66MB 00:04:18.786 EAL: Trying to obtain current memory policy. 00:04:18.786 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:18.786 EAL: Restoring previous memory policy: 4 00:04:18.786 EAL: Calling mem event callback 'spdk:(nil)' 00:04:18.786 EAL: request: mp_malloc_sync 00:04:18.786 EAL: No shared files mode enabled, IPC is disabled 00:04:18.786 EAL: Heap on socket 0 was expanded by 130MB 00:04:19.048 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.048 EAL: request: mp_malloc_sync 00:04:19.048 EAL: No shared files mode enabled, IPC is disabled 00:04:19.048 EAL: Heap on socket 0 was shrunk by 130MB 00:04:19.048 EAL: Trying to obtain current memory policy. 00:04:19.048 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:19.048 EAL: Restoring previous memory policy: 4 00:04:19.048 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.048 EAL: request: mp_malloc_sync 00:04:19.048 EAL: No shared files mode enabled, IPC is disabled 00:04:19.048 EAL: Heap on socket 0 was expanded by 258MB 00:04:19.048 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.048 EAL: request: mp_malloc_sync 00:04:19.048 EAL: No shared files mode enabled, IPC is disabled 00:04:19.048 EAL: Heap on socket 0 was shrunk by 258MB 00:04:19.048 EAL: Trying to obtain current memory policy. 00:04:19.048 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:19.048 EAL: Restoring previous memory policy: 4 00:04:19.048 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.048 EAL: request: mp_malloc_sync 00:04:19.048 EAL: No shared files mode enabled, IPC is disabled 00:04:19.048 EAL: Heap on socket 0 was expanded by 514MB 00:04:19.048 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.310 EAL: request: mp_malloc_sync 00:04:19.310 EAL: No shared files mode enabled, IPC is disabled 00:04:19.310 EAL: Heap on socket 0 was shrunk by 514MB 00:04:19.310 EAL: Trying to obtain current memory policy. 00:04:19.310 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:19.310 EAL: Restoring previous memory policy: 4 00:04:19.310 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.310 EAL: request: mp_malloc_sync 00:04:19.310 EAL: No shared files mode enabled, IPC is disabled 00:04:19.310 EAL: Heap on socket 0 was expanded by 1026MB 00:04:19.310 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.571 EAL: request: mp_malloc_sync 00:04:19.571 EAL: No shared files mode enabled, IPC is disabled 00:04:19.571 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:19.571 passed 00:04:19.571 00:04:19.571 Run Summary: Type Total Ran Passed Failed Inactive 00:04:19.571 suites 1 1 n/a 0 0 00:04:19.571 tests 2 2 2 0 0 00:04:19.571 asserts 497 497 497 0 n/a 00:04:19.571 00:04:19.571 Elapsed time = 0.661 seconds 00:04:19.571 EAL: Calling mem event callback 'spdk:(nil)' 00:04:19.571 EAL: request: mp_malloc_sync 00:04:19.571 EAL: No shared files mode enabled, IPC is disabled 00:04:19.571 EAL: Heap on socket 0 was shrunk by 2MB 00:04:19.571 EAL: No shared files mode enabled, IPC is disabled 00:04:19.571 EAL: No shared files mode enabled, IPC is disabled 00:04:19.571 EAL: No shared files mode enabled, IPC is disabled 00:04:19.571 00:04:19.571 real 0m0.785s 00:04:19.571 user 0m0.409s 00:04:19.571 sys 0m0.344s 00:04:19.571 14:52:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:19.571 14:52:00 -- common/autotest_common.sh@10 -- # set +x 00:04:19.571 ************************************ 00:04:19.571 END TEST env_vtophys 00:04:19.571 ************************************ 00:04:19.571 14:52:00 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:19.571 14:52:00 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:19.571 14:52:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:19.571 14:52:00 -- common/autotest_common.sh@10 -- # set +x 00:04:19.832 ************************************ 00:04:19.832 START TEST env_pci 00:04:19.832 ************************************ 00:04:19.832 14:52:00 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:19.832 00:04:19.832 00:04:19.832 CUnit - A unit testing framework for C - Version 2.1-3 00:04:19.832 http://cunit.sourceforge.net/ 00:04:19.832 00:04:19.832 00:04:19.832 Suite: pci 00:04:19.832 Test: pci_hook ...[2024-04-26 14:52:00.543686] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3302952 has claimed it 00:04:19.832 EAL: Cannot find device (10000:00:01.0) 00:04:19.832 EAL: Failed to attach device on primary process 00:04:19.832 passed 00:04:19.832 00:04:19.832 Run Summary: Type Total Ran Passed Failed Inactive 00:04:19.832 suites 1 1 n/a 0 0 00:04:19.832 tests 1 1 1 0 0 00:04:19.832 asserts 25 25 25 0 n/a 00:04:19.832 00:04:19.832 Elapsed time = 0.029 seconds 00:04:19.832 00:04:19.832 real 0m0.046s 00:04:19.832 user 0m0.014s 00:04:19.832 sys 0m0.032s 00:04:19.832 14:52:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:19.832 14:52:00 -- common/autotest_common.sh@10 -- # set +x 00:04:19.832 ************************************ 00:04:19.832 END TEST env_pci 00:04:19.832 ************************************ 00:04:19.832 14:52:00 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:19.832 14:52:00 -- env/env.sh@15 -- # uname 00:04:19.832 14:52:00 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:19.832 14:52:00 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:19.832 14:52:00 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:19.832 14:52:00 -- common/autotest_common.sh@1097 -- # '[' 5 -le 1 ']' 00:04:19.832 14:52:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:19.832 14:52:00 -- common/autotest_common.sh@10 -- # set +x 00:04:19.832 ************************************ 00:04:19.832 START TEST env_dpdk_post_init 00:04:19.832 ************************************ 00:04:19.832 14:52:00 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:19.832 EAL: Detected CPU lcores: 128 00:04:19.832 EAL: Detected NUMA nodes: 2 00:04:19.832 EAL: Detected shared linkage of DPDK 00:04:20.092 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:20.092 EAL: Selected IOVA mode 'VA' 00:04:20.092 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.092 EAL: VFIO support initialized 00:04:20.092 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:20.092 EAL: Using IOMMU type 1 (Type 1) 00:04:20.092 EAL: Ignore mapping IO port bar(1) 00:04:20.365 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.0 (socket 0) 00:04:20.365 EAL: Ignore mapping IO port bar(1) 00:04:20.365 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.1 (socket 0) 00:04:20.629 EAL: Ignore mapping IO port bar(1) 00:04:20.629 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.2 (socket 0) 00:04:20.889 EAL: Ignore mapping IO port bar(1) 00:04:20.889 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.3 (socket 0) 00:04:21.150 EAL: Ignore mapping IO port bar(1) 00:04:21.150 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.4 (socket 0) 00:04:21.150 EAL: Ignore mapping IO port bar(1) 00:04:21.411 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.5 (socket 0) 00:04:21.411 EAL: Ignore mapping IO port bar(1) 00:04:21.672 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.6 (socket 0) 00:04:21.672 EAL: Ignore mapping IO port bar(1) 00:04:21.932 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:00:01.7 (socket 0) 00:04:21.932 EAL: Probe PCI driver: spdk_nvme (144d:a80a) device: 0000:65:00.0 (socket 0) 00:04:22.194 EAL: Ignore mapping IO port bar(1) 00:04:22.194 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.0 (socket 1) 00:04:22.604 EAL: Ignore mapping IO port bar(1) 00:04:22.604 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.1 (socket 1) 00:04:22.604 EAL: Ignore mapping IO port bar(1) 00:04:22.894 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.2 (socket 1) 00:04:22.894 EAL: Ignore mapping IO port bar(1) 00:04:22.894 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.3 (socket 1) 00:04:23.155 EAL: Ignore mapping IO port bar(1) 00:04:23.155 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.4 (socket 1) 00:04:23.416 EAL: Ignore mapping IO port bar(1) 00:04:23.416 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.5 (socket 1) 00:04:23.416 EAL: Ignore mapping IO port bar(1) 00:04:23.677 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.6 (socket 1) 00:04:23.677 EAL: Ignore mapping IO port bar(1) 00:04:23.938 EAL: Probe PCI driver: spdk_ioat (8086:0b00) device: 0000:80:01.7 (socket 1) 00:04:23.938 EAL: Releasing PCI mapped resource for 0000:65:00.0 00:04:23.938 EAL: Calling pci_unmap_resource for 0000:65:00.0 at 0x202001020000 00:04:23.938 Starting DPDK initialization... 00:04:23.938 Starting SPDK post initialization... 00:04:23.938 SPDK NVMe probe 00:04:23.938 Attaching to 0000:65:00.0 00:04:23.938 Attached to 0000:65:00.0 00:04:23.938 Cleaning up... 00:04:25.852 00:04:25.852 real 0m5.710s 00:04:25.852 user 0m0.181s 00:04:25.852 sys 0m0.074s 00:04:25.852 14:52:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:25.852 14:52:06 -- common/autotest_common.sh@10 -- # set +x 00:04:25.852 ************************************ 00:04:25.852 END TEST env_dpdk_post_init 00:04:25.852 ************************************ 00:04:25.852 14:52:06 -- env/env.sh@26 -- # uname 00:04:25.852 14:52:06 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:25.852 14:52:06 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:25.852 14:52:06 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:25.852 14:52:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:25.852 14:52:06 -- common/autotest_common.sh@10 -- # set +x 00:04:25.852 ************************************ 00:04:25.852 START TEST env_mem_callbacks 00:04:25.852 ************************************ 00:04:25.852 14:52:06 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:25.852 EAL: Detected CPU lcores: 128 00:04:25.852 EAL: Detected NUMA nodes: 2 00:04:25.852 EAL: Detected shared linkage of DPDK 00:04:25.852 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:25.852 EAL: Selected IOVA mode 'VA' 00:04:25.852 EAL: No free 2048 kB hugepages reported on node 1 00:04:25.852 EAL: VFIO support initialized 00:04:25.852 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:25.852 00:04:25.852 00:04:25.852 CUnit - A unit testing framework for C - Version 2.1-3 00:04:25.852 http://cunit.sourceforge.net/ 00:04:25.852 00:04:25.852 00:04:25.852 Suite: memory 00:04:25.852 Test: test ... 00:04:25.852 register 0x200000200000 2097152 00:04:25.852 malloc 3145728 00:04:25.852 register 0x200000400000 4194304 00:04:25.852 buf 0x200000500000 len 3145728 PASSED 00:04:25.852 malloc 64 00:04:25.852 buf 0x2000004fff40 len 64 PASSED 00:04:25.852 malloc 4194304 00:04:25.852 register 0x200000800000 6291456 00:04:25.852 buf 0x200000a00000 len 4194304 PASSED 00:04:25.852 free 0x200000500000 3145728 00:04:25.852 free 0x2000004fff40 64 00:04:25.852 unregister 0x200000400000 4194304 PASSED 00:04:25.852 free 0x200000a00000 4194304 00:04:25.852 unregister 0x200000800000 6291456 PASSED 00:04:25.852 malloc 8388608 00:04:25.852 register 0x200000400000 10485760 00:04:25.852 buf 0x200000600000 len 8388608 PASSED 00:04:25.852 free 0x200000600000 8388608 00:04:25.852 unregister 0x200000400000 10485760 PASSED 00:04:25.852 passed 00:04:25.852 00:04:25.852 Run Summary: Type Total Ran Passed Failed Inactive 00:04:25.852 suites 1 1 n/a 0 0 00:04:25.852 tests 1 1 1 0 0 00:04:25.852 asserts 15 15 15 0 n/a 00:04:25.852 00:04:25.852 Elapsed time = 0.006 seconds 00:04:25.852 00:04:25.852 real 0m0.063s 00:04:25.852 user 0m0.019s 00:04:25.852 sys 0m0.044s 00:04:25.852 14:52:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:25.852 14:52:06 -- common/autotest_common.sh@10 -- # set +x 00:04:25.852 ************************************ 00:04:25.852 END TEST env_mem_callbacks 00:04:25.852 ************************************ 00:04:25.852 00:04:25.852 real 0m7.812s 00:04:25.852 user 0m1.201s 00:04:25.852 sys 0m1.071s 00:04:25.852 14:52:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:25.852 14:52:06 -- common/autotest_common.sh@10 -- # set +x 00:04:25.852 ************************************ 00:04:25.852 END TEST env 00:04:25.852 ************************************ 00:04:25.852 14:52:06 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:25.852 14:52:06 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:25.852 14:52:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:25.852 14:52:06 -- common/autotest_common.sh@10 -- # set +x 00:04:26.115 ************************************ 00:04:26.115 START TEST rpc 00:04:26.115 ************************************ 00:04:26.115 14:52:06 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:26.115 * Looking for test storage... 00:04:26.115 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:26.115 14:52:07 -- rpc/rpc.sh@65 -- # spdk_pid=3304316 00:04:26.115 14:52:07 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:26.115 14:52:07 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:26.115 14:52:07 -- rpc/rpc.sh@67 -- # waitforlisten 3304316 00:04:26.115 14:52:07 -- common/autotest_common.sh@827 -- # '[' -z 3304316 ']' 00:04:26.115 14:52:07 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.115 14:52:07 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:26.115 14:52:07 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.115 14:52:07 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:26.115 14:52:07 -- common/autotest_common.sh@10 -- # set +x 00:04:26.376 [2024-04-26 14:52:07.105335] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:26.376 [2024-04-26 14:52:07.105404] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3304316 ] 00:04:26.376 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.376 [2024-04-26 14:52:07.169749] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.376 [2024-04-26 14:52:07.242091] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:26.376 [2024-04-26 14:52:07.242130] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3304316' to capture a snapshot of events at runtime. 00:04:26.376 [2024-04-26 14:52:07.242137] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:26.376 [2024-04-26 14:52:07.242144] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:26.376 [2024-04-26 14:52:07.242150] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3304316 for offline analysis/debug. 00:04:26.376 [2024-04-26 14:52:07.242178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.947 14:52:07 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:26.947 14:52:07 -- common/autotest_common.sh@860 -- # return 0 00:04:26.947 14:52:07 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:26.947 14:52:07 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:26.947 14:52:07 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:26.947 14:52:07 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:26.947 14:52:07 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:26.947 14:52:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:26.947 14:52:07 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 ************************************ 00:04:27.209 START TEST rpc_integrity 00:04:27.209 ************************************ 00:04:27.209 14:52:08 -- common/autotest_common.sh@1121 -- # rpc_integrity 00:04:27.209 14:52:08 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:27.209 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.209 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.209 14:52:08 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:27.209 14:52:08 -- rpc/rpc.sh@13 -- # jq length 00:04:27.209 14:52:08 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:27.209 14:52:08 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:27.209 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.209 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.209 14:52:08 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:27.209 14:52:08 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:27.209 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.209 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.209 14:52:08 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:27.209 { 00:04:27.209 "name": "Malloc0", 00:04:27.209 "aliases": [ 00:04:27.209 "d3bf17a5-3202-4361-9141-62b7ffbdac47" 00:04:27.209 ], 00:04:27.209 "product_name": "Malloc disk", 00:04:27.209 "block_size": 512, 00:04:27.209 "num_blocks": 16384, 00:04:27.209 "uuid": "d3bf17a5-3202-4361-9141-62b7ffbdac47", 00:04:27.209 "assigned_rate_limits": { 00:04:27.209 "rw_ios_per_sec": 0, 00:04:27.209 "rw_mbytes_per_sec": 0, 00:04:27.209 "r_mbytes_per_sec": 0, 00:04:27.209 "w_mbytes_per_sec": 0 00:04:27.209 }, 00:04:27.209 "claimed": false, 00:04:27.209 "zoned": false, 00:04:27.209 "supported_io_types": { 00:04:27.209 "read": true, 00:04:27.209 "write": true, 00:04:27.209 "unmap": true, 00:04:27.209 "write_zeroes": true, 00:04:27.209 "flush": true, 00:04:27.209 "reset": true, 00:04:27.209 "compare": false, 00:04:27.209 "compare_and_write": false, 00:04:27.209 "abort": true, 00:04:27.209 "nvme_admin": false, 00:04:27.209 "nvme_io": false 00:04:27.209 }, 00:04:27.209 "memory_domains": [ 00:04:27.209 { 00:04:27.209 "dma_device_id": "system", 00:04:27.209 "dma_device_type": 1 00:04:27.209 }, 00:04:27.209 { 00:04:27.209 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:27.209 "dma_device_type": 2 00:04:27.209 } 00:04:27.209 ], 00:04:27.209 "driver_specific": {} 00:04:27.209 } 00:04:27.209 ]' 00:04:27.209 14:52:08 -- rpc/rpc.sh@17 -- # jq length 00:04:27.209 14:52:08 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:27.209 14:52:08 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:27.209 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.209 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.209 [2024-04-26 14:52:08.149644] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:27.209 [2024-04-26 14:52:08.149677] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:27.209 [2024-04-26 14:52:08.149689] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xc60c00 00:04:27.209 [2024-04-26 14:52:08.149696] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:27.209 [2024-04-26 14:52:08.151061] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:27.209 [2024-04-26 14:52:08.151082] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:27.209 Passthru0 00:04:27.209 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.209 14:52:08 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:27.209 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.209 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.470 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.470 14:52:08 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:27.470 { 00:04:27.470 "name": "Malloc0", 00:04:27.470 "aliases": [ 00:04:27.470 "d3bf17a5-3202-4361-9141-62b7ffbdac47" 00:04:27.470 ], 00:04:27.470 "product_name": "Malloc disk", 00:04:27.470 "block_size": 512, 00:04:27.470 "num_blocks": 16384, 00:04:27.470 "uuid": "d3bf17a5-3202-4361-9141-62b7ffbdac47", 00:04:27.470 "assigned_rate_limits": { 00:04:27.470 "rw_ios_per_sec": 0, 00:04:27.470 "rw_mbytes_per_sec": 0, 00:04:27.470 "r_mbytes_per_sec": 0, 00:04:27.470 "w_mbytes_per_sec": 0 00:04:27.470 }, 00:04:27.470 "claimed": true, 00:04:27.470 "claim_type": "exclusive_write", 00:04:27.470 "zoned": false, 00:04:27.470 "supported_io_types": { 00:04:27.470 "read": true, 00:04:27.470 "write": true, 00:04:27.470 "unmap": true, 00:04:27.470 "write_zeroes": true, 00:04:27.470 "flush": true, 00:04:27.470 "reset": true, 00:04:27.470 "compare": false, 00:04:27.470 "compare_and_write": false, 00:04:27.470 "abort": true, 00:04:27.470 "nvme_admin": false, 00:04:27.470 "nvme_io": false 00:04:27.470 }, 00:04:27.470 "memory_domains": [ 00:04:27.470 { 00:04:27.470 "dma_device_id": "system", 00:04:27.470 "dma_device_type": 1 00:04:27.470 }, 00:04:27.470 { 00:04:27.470 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:27.470 "dma_device_type": 2 00:04:27.470 } 00:04:27.470 ], 00:04:27.470 "driver_specific": {} 00:04:27.470 }, 00:04:27.470 { 00:04:27.470 "name": "Passthru0", 00:04:27.470 "aliases": [ 00:04:27.470 "372f24a4-2d66-5fb6-83cb-0a8df2e0c66d" 00:04:27.470 ], 00:04:27.470 "product_name": "passthru", 00:04:27.470 "block_size": 512, 00:04:27.470 "num_blocks": 16384, 00:04:27.470 "uuid": "372f24a4-2d66-5fb6-83cb-0a8df2e0c66d", 00:04:27.470 "assigned_rate_limits": { 00:04:27.470 "rw_ios_per_sec": 0, 00:04:27.470 "rw_mbytes_per_sec": 0, 00:04:27.470 "r_mbytes_per_sec": 0, 00:04:27.470 "w_mbytes_per_sec": 0 00:04:27.470 }, 00:04:27.470 "claimed": false, 00:04:27.470 "zoned": false, 00:04:27.470 "supported_io_types": { 00:04:27.470 "read": true, 00:04:27.470 "write": true, 00:04:27.470 "unmap": true, 00:04:27.470 "write_zeroes": true, 00:04:27.470 "flush": true, 00:04:27.470 "reset": true, 00:04:27.470 "compare": false, 00:04:27.470 "compare_and_write": false, 00:04:27.470 "abort": true, 00:04:27.470 "nvme_admin": false, 00:04:27.470 "nvme_io": false 00:04:27.470 }, 00:04:27.470 "memory_domains": [ 00:04:27.470 { 00:04:27.470 "dma_device_id": "system", 00:04:27.470 "dma_device_type": 1 00:04:27.470 }, 00:04:27.470 { 00:04:27.470 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:27.470 "dma_device_type": 2 00:04:27.470 } 00:04:27.470 ], 00:04:27.470 "driver_specific": { 00:04:27.470 "passthru": { 00:04:27.470 "name": "Passthru0", 00:04:27.470 "base_bdev_name": "Malloc0" 00:04:27.470 } 00:04:27.470 } 00:04:27.470 } 00:04:27.470 ]' 00:04:27.470 14:52:08 -- rpc/rpc.sh@21 -- # jq length 00:04:27.470 14:52:08 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:27.470 14:52:08 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:27.470 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.470 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.470 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.470 14:52:08 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:27.470 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.470 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.470 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.470 14:52:08 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:27.470 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.470 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.470 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.470 14:52:08 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:27.470 14:52:08 -- rpc/rpc.sh@26 -- # jq length 00:04:27.470 14:52:08 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:27.470 00:04:27.470 real 0m0.298s 00:04:27.470 user 0m0.198s 00:04:27.470 sys 0m0.032s 00:04:27.470 14:52:08 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:27.470 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.470 ************************************ 00:04:27.470 END TEST rpc_integrity 00:04:27.470 ************************************ 00:04:27.470 14:52:08 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:27.470 14:52:08 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:27.470 14:52:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:27.470 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 ************************************ 00:04:27.731 START TEST rpc_plugins 00:04:27.731 ************************************ 00:04:27.731 14:52:08 -- common/autotest_common.sh@1121 -- # rpc_plugins 00:04:27.731 14:52:08 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:27.731 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.731 14:52:08 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:27.731 14:52:08 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:27.731 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.731 14:52:08 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:27.731 { 00:04:27.731 "name": "Malloc1", 00:04:27.731 "aliases": [ 00:04:27.731 "60d7de8d-cdc0-4c57-8185-34f6071911a3" 00:04:27.731 ], 00:04:27.731 "product_name": "Malloc disk", 00:04:27.731 "block_size": 4096, 00:04:27.731 "num_blocks": 256, 00:04:27.731 "uuid": "60d7de8d-cdc0-4c57-8185-34f6071911a3", 00:04:27.731 "assigned_rate_limits": { 00:04:27.731 "rw_ios_per_sec": 0, 00:04:27.731 "rw_mbytes_per_sec": 0, 00:04:27.731 "r_mbytes_per_sec": 0, 00:04:27.731 "w_mbytes_per_sec": 0 00:04:27.731 }, 00:04:27.731 "claimed": false, 00:04:27.731 "zoned": false, 00:04:27.731 "supported_io_types": { 00:04:27.731 "read": true, 00:04:27.731 "write": true, 00:04:27.731 "unmap": true, 00:04:27.731 "write_zeroes": true, 00:04:27.731 "flush": true, 00:04:27.731 "reset": true, 00:04:27.731 "compare": false, 00:04:27.731 "compare_and_write": false, 00:04:27.731 "abort": true, 00:04:27.731 "nvme_admin": false, 00:04:27.731 "nvme_io": false 00:04:27.731 }, 00:04:27.731 "memory_domains": [ 00:04:27.731 { 00:04:27.731 "dma_device_id": "system", 00:04:27.731 "dma_device_type": 1 00:04:27.731 }, 00:04:27.731 { 00:04:27.731 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:27.731 "dma_device_type": 2 00:04:27.731 } 00:04:27.731 ], 00:04:27.731 "driver_specific": {} 00:04:27.731 } 00:04:27.731 ]' 00:04:27.731 14:52:08 -- rpc/rpc.sh@32 -- # jq length 00:04:27.731 14:52:08 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:27.731 14:52:08 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:27.731 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.731 14:52:08 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:27.731 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.731 14:52:08 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:27.731 14:52:08 -- rpc/rpc.sh@36 -- # jq length 00:04:27.731 14:52:08 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:27.731 00:04:27.731 real 0m0.151s 00:04:27.731 user 0m0.095s 00:04:27.731 sys 0m0.019s 00:04:27.731 14:52:08 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.731 ************************************ 00:04:27.731 END TEST rpc_plugins 00:04:27.731 ************************************ 00:04:27.731 14:52:08 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:27.731 14:52:08 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:27.731 14:52:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:27.731 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.991 ************************************ 00:04:27.991 START TEST rpc_trace_cmd_test 00:04:27.991 ************************************ 00:04:27.991 14:52:08 -- common/autotest_common.sh@1121 -- # rpc_trace_cmd_test 00:04:27.991 14:52:08 -- rpc/rpc.sh@40 -- # local info 00:04:27.991 14:52:08 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:27.991 14:52:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:27.991 14:52:08 -- common/autotest_common.sh@10 -- # set +x 00:04:27.991 14:52:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:27.991 14:52:08 -- rpc/rpc.sh@42 -- # info='{ 00:04:27.991 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3304316", 00:04:27.991 "tpoint_group_mask": "0x8", 00:04:27.991 "iscsi_conn": { 00:04:27.991 "mask": "0x2", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "scsi": { 00:04:27.991 "mask": "0x4", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "bdev": { 00:04:27.991 "mask": "0x8", 00:04:27.991 "tpoint_mask": "0xffffffffffffffff" 00:04:27.991 }, 00:04:27.991 "nvmf_rdma": { 00:04:27.991 "mask": "0x10", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "nvmf_tcp": { 00:04:27.991 "mask": "0x20", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "ftl": { 00:04:27.991 "mask": "0x40", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "blobfs": { 00:04:27.991 "mask": "0x80", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "dsa": { 00:04:27.991 "mask": "0x200", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "thread": { 00:04:27.991 "mask": "0x400", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "nvme_pcie": { 00:04:27.991 "mask": "0x800", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "iaa": { 00:04:27.991 "mask": "0x1000", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "nvme_tcp": { 00:04:27.991 "mask": "0x2000", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "bdev_nvme": { 00:04:27.991 "mask": "0x4000", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 }, 00:04:27.991 "sock": { 00:04:27.991 "mask": "0x8000", 00:04:27.991 "tpoint_mask": "0x0" 00:04:27.991 } 00:04:27.991 }' 00:04:27.991 14:52:08 -- rpc/rpc.sh@43 -- # jq length 00:04:27.991 14:52:08 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:27.992 14:52:08 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:27.992 14:52:08 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:27.992 14:52:08 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:28.252 14:52:08 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:28.252 14:52:08 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:28.252 14:52:09 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:28.252 14:52:09 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:28.252 14:52:09 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:28.252 00:04:28.252 real 0m0.247s 00:04:28.252 user 0m0.206s 00:04:28.252 sys 0m0.032s 00:04:28.252 14:52:09 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:28.252 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.252 ************************************ 00:04:28.252 END TEST rpc_trace_cmd_test 00:04:28.252 ************************************ 00:04:28.252 14:52:09 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:28.252 14:52:09 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:28.252 14:52:09 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:28.252 14:52:09 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:28.252 14:52:09 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:28.252 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.512 ************************************ 00:04:28.512 START TEST rpc_daemon_integrity 00:04:28.512 ************************************ 00:04:28.512 14:52:09 -- common/autotest_common.sh@1121 -- # rpc_integrity 00:04:28.512 14:52:09 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:28.512 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.512 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.512 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.512 14:52:09 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:28.512 14:52:09 -- rpc/rpc.sh@13 -- # jq length 00:04:28.512 14:52:09 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:28.512 14:52:09 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:28.512 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.512 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.512 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.512 14:52:09 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:28.512 14:52:09 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:28.512 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.512 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.512 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.512 14:52:09 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:28.512 { 00:04:28.512 "name": "Malloc2", 00:04:28.512 "aliases": [ 00:04:28.512 "e7732d7b-d1ee-41cf-a810-7d6f2825cb74" 00:04:28.512 ], 00:04:28.512 "product_name": "Malloc disk", 00:04:28.512 "block_size": 512, 00:04:28.512 "num_blocks": 16384, 00:04:28.512 "uuid": "e7732d7b-d1ee-41cf-a810-7d6f2825cb74", 00:04:28.512 "assigned_rate_limits": { 00:04:28.512 "rw_ios_per_sec": 0, 00:04:28.512 "rw_mbytes_per_sec": 0, 00:04:28.512 "r_mbytes_per_sec": 0, 00:04:28.512 "w_mbytes_per_sec": 0 00:04:28.512 }, 00:04:28.512 "claimed": false, 00:04:28.512 "zoned": false, 00:04:28.512 "supported_io_types": { 00:04:28.512 "read": true, 00:04:28.513 "write": true, 00:04:28.513 "unmap": true, 00:04:28.513 "write_zeroes": true, 00:04:28.513 "flush": true, 00:04:28.513 "reset": true, 00:04:28.513 "compare": false, 00:04:28.513 "compare_and_write": false, 00:04:28.513 "abort": true, 00:04:28.513 "nvme_admin": false, 00:04:28.513 "nvme_io": false 00:04:28.513 }, 00:04:28.513 "memory_domains": [ 00:04:28.513 { 00:04:28.513 "dma_device_id": "system", 00:04:28.513 "dma_device_type": 1 00:04:28.513 }, 00:04:28.513 { 00:04:28.513 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:28.513 "dma_device_type": 2 00:04:28.513 } 00:04:28.513 ], 00:04:28.513 "driver_specific": {} 00:04:28.513 } 00:04:28.513 ]' 00:04:28.513 14:52:09 -- rpc/rpc.sh@17 -- # jq length 00:04:28.513 14:52:09 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:28.513 14:52:09 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:28.513 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.513 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.513 [2024-04-26 14:52:09.380998] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:28.513 [2024-04-26 14:52:09.381028] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:28.513 [2024-04-26 14:52:09.381040] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xe04900 00:04:28.513 [2024-04-26 14:52:09.381047] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:28.513 [2024-04-26 14:52:09.382256] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:28.513 [2024-04-26 14:52:09.382283] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:28.513 Passthru0 00:04:28.513 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.513 14:52:09 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:28.513 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.513 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.513 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.513 14:52:09 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:28.513 { 00:04:28.513 "name": "Malloc2", 00:04:28.513 "aliases": [ 00:04:28.513 "e7732d7b-d1ee-41cf-a810-7d6f2825cb74" 00:04:28.513 ], 00:04:28.513 "product_name": "Malloc disk", 00:04:28.513 "block_size": 512, 00:04:28.513 "num_blocks": 16384, 00:04:28.513 "uuid": "e7732d7b-d1ee-41cf-a810-7d6f2825cb74", 00:04:28.513 "assigned_rate_limits": { 00:04:28.513 "rw_ios_per_sec": 0, 00:04:28.513 "rw_mbytes_per_sec": 0, 00:04:28.513 "r_mbytes_per_sec": 0, 00:04:28.513 "w_mbytes_per_sec": 0 00:04:28.513 }, 00:04:28.513 "claimed": true, 00:04:28.513 "claim_type": "exclusive_write", 00:04:28.513 "zoned": false, 00:04:28.513 "supported_io_types": { 00:04:28.513 "read": true, 00:04:28.513 "write": true, 00:04:28.513 "unmap": true, 00:04:28.513 "write_zeroes": true, 00:04:28.513 "flush": true, 00:04:28.513 "reset": true, 00:04:28.513 "compare": false, 00:04:28.513 "compare_and_write": false, 00:04:28.513 "abort": true, 00:04:28.513 "nvme_admin": false, 00:04:28.513 "nvme_io": false 00:04:28.513 }, 00:04:28.513 "memory_domains": [ 00:04:28.513 { 00:04:28.513 "dma_device_id": "system", 00:04:28.513 "dma_device_type": 1 00:04:28.513 }, 00:04:28.513 { 00:04:28.513 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:28.513 "dma_device_type": 2 00:04:28.513 } 00:04:28.513 ], 00:04:28.513 "driver_specific": {} 00:04:28.513 }, 00:04:28.513 { 00:04:28.513 "name": "Passthru0", 00:04:28.513 "aliases": [ 00:04:28.513 "e93ad609-8fd2-5e3d-86cc-e805b1eb1bf8" 00:04:28.513 ], 00:04:28.513 "product_name": "passthru", 00:04:28.513 "block_size": 512, 00:04:28.513 "num_blocks": 16384, 00:04:28.513 "uuid": "e93ad609-8fd2-5e3d-86cc-e805b1eb1bf8", 00:04:28.513 "assigned_rate_limits": { 00:04:28.513 "rw_ios_per_sec": 0, 00:04:28.513 "rw_mbytes_per_sec": 0, 00:04:28.513 "r_mbytes_per_sec": 0, 00:04:28.513 "w_mbytes_per_sec": 0 00:04:28.513 }, 00:04:28.513 "claimed": false, 00:04:28.513 "zoned": false, 00:04:28.513 "supported_io_types": { 00:04:28.513 "read": true, 00:04:28.513 "write": true, 00:04:28.513 "unmap": true, 00:04:28.513 "write_zeroes": true, 00:04:28.513 "flush": true, 00:04:28.513 "reset": true, 00:04:28.513 "compare": false, 00:04:28.513 "compare_and_write": false, 00:04:28.513 "abort": true, 00:04:28.513 "nvme_admin": false, 00:04:28.513 "nvme_io": false 00:04:28.513 }, 00:04:28.513 "memory_domains": [ 00:04:28.513 { 00:04:28.513 "dma_device_id": "system", 00:04:28.513 "dma_device_type": 1 00:04:28.513 }, 00:04:28.513 { 00:04:28.513 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:28.513 "dma_device_type": 2 00:04:28.513 } 00:04:28.513 ], 00:04:28.513 "driver_specific": { 00:04:28.513 "passthru": { 00:04:28.513 "name": "Passthru0", 00:04:28.513 "base_bdev_name": "Malloc2" 00:04:28.513 } 00:04:28.513 } 00:04:28.513 } 00:04:28.513 ]' 00:04:28.513 14:52:09 -- rpc/rpc.sh@21 -- # jq length 00:04:28.513 14:52:09 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:28.513 14:52:09 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:28.513 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.513 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.773 14:52:09 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:28.773 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.773 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.773 14:52:09 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:28.773 14:52:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:28.773 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 14:52:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:28.773 14:52:09 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:28.773 14:52:09 -- rpc/rpc.sh@26 -- # jq length 00:04:28.773 14:52:09 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:28.773 00:04:28.773 real 0m0.281s 00:04:28.773 user 0m0.176s 00:04:28.773 sys 0m0.042s 00:04:28.773 14:52:09 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:28.773 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:28.773 ************************************ 00:04:28.773 END TEST rpc_daemon_integrity 00:04:28.773 ************************************ 00:04:28.773 14:52:09 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:28.773 14:52:09 -- rpc/rpc.sh@84 -- # killprocess 3304316 00:04:28.773 14:52:09 -- common/autotest_common.sh@946 -- # '[' -z 3304316 ']' 00:04:28.773 14:52:09 -- common/autotest_common.sh@950 -- # kill -0 3304316 00:04:28.773 14:52:09 -- common/autotest_common.sh@951 -- # uname 00:04:28.773 14:52:09 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:28.773 14:52:09 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3304316 00:04:28.773 14:52:09 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:28.773 14:52:09 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:28.774 14:52:09 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3304316' 00:04:28.774 killing process with pid 3304316 00:04:28.774 14:52:09 -- common/autotest_common.sh@965 -- # kill 3304316 00:04:28.774 14:52:09 -- common/autotest_common.sh@970 -- # wait 3304316 00:04:29.034 00:04:29.034 real 0m2.878s 00:04:29.034 user 0m3.844s 00:04:29.034 sys 0m0.840s 00:04:29.034 14:52:09 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:29.034 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:29.034 ************************************ 00:04:29.034 END TEST rpc 00:04:29.034 ************************************ 00:04:29.034 14:52:09 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:29.034 14:52:09 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:29.034 14:52:09 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:29.034 14:52:09 -- common/autotest_common.sh@10 -- # set +x 00:04:29.295 ************************************ 00:04:29.295 START TEST skip_rpc 00:04:29.295 ************************************ 00:04:29.295 14:52:09 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:29.295 * Looking for test storage... 00:04:29.295 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:29.295 14:52:10 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:29.295 14:52:10 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:29.295 14:52:10 -- common/autotest_common.sh@10 -- # set +x 00:04:29.295 ************************************ 00:04:29.295 START TEST skip_rpc 00:04:29.295 ************************************ 00:04:29.295 14:52:10 -- common/autotest_common.sh@1121 -- # test_skip_rpc 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=3305111 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:29.295 14:52:10 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:29.558 [2024-04-26 14:52:10.296504] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:29.558 [2024-04-26 14:52:10.296559] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3305111 ] 00:04:29.558 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.558 [2024-04-26 14:52:10.362014] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.558 [2024-04-26 14:52:10.436018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:34.890 14:52:15 -- common/autotest_common.sh@648 -- # local es=0 00:04:34.890 14:52:15 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:34.890 14:52:15 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:04:34.890 14:52:15 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:34.890 14:52:15 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:04:34.890 14:52:15 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:34.890 14:52:15 -- common/autotest_common.sh@651 -- # rpc_cmd spdk_get_version 00:04:34.890 14:52:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:34.890 14:52:15 -- common/autotest_common.sh@10 -- # set +x 00:04:34.890 14:52:15 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:04:34.890 14:52:15 -- common/autotest_common.sh@651 -- # es=1 00:04:34.890 14:52:15 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:04:34.890 14:52:15 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:04:34.890 14:52:15 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@23 -- # killprocess 3305111 00:04:34.890 14:52:15 -- common/autotest_common.sh@946 -- # '[' -z 3305111 ']' 00:04:34.890 14:52:15 -- common/autotest_common.sh@950 -- # kill -0 3305111 00:04:34.890 14:52:15 -- common/autotest_common.sh@951 -- # uname 00:04:34.890 14:52:15 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:34.890 14:52:15 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3305111 00:04:34.890 14:52:15 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:34.890 14:52:15 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:34.890 14:52:15 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3305111' 00:04:34.890 killing process with pid 3305111 00:04:34.890 14:52:15 -- common/autotest_common.sh@965 -- # kill 3305111 00:04:34.890 14:52:15 -- common/autotest_common.sh@970 -- # wait 3305111 00:04:34.890 00:04:34.890 real 0m5.276s 00:04:34.890 user 0m5.075s 00:04:34.890 sys 0m0.237s 00:04:34.890 14:52:15 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:34.890 14:52:15 -- common/autotest_common.sh@10 -- # set +x 00:04:34.890 ************************************ 00:04:34.890 END TEST skip_rpc 00:04:34.890 ************************************ 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:34.890 14:52:15 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:34.890 14:52:15 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:34.890 14:52:15 -- common/autotest_common.sh@10 -- # set +x 00:04:34.890 ************************************ 00:04:34.890 START TEST skip_rpc_with_json 00:04:34.890 ************************************ 00:04:34.890 14:52:15 -- common/autotest_common.sh@1121 -- # test_skip_rpc_with_json 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=3306360 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@31 -- # waitforlisten 3306360 00:04:34.890 14:52:15 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:34.890 14:52:15 -- common/autotest_common.sh@827 -- # '[' -z 3306360 ']' 00:04:34.890 14:52:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.890 14:52:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:34.890 14:52:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.890 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.890 14:52:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:34.890 14:52:15 -- common/autotest_common.sh@10 -- # set +x 00:04:34.890 [2024-04-26 14:52:15.748031] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:34.890 [2024-04-26 14:52:15.748079] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3306360 ] 00:04:34.890 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.890 [2024-04-26 14:52:15.808945] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.152 [2024-04-26 14:52:15.876451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.723 14:52:16 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:35.723 14:52:16 -- common/autotest_common.sh@860 -- # return 0 00:04:35.723 14:52:16 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:35.723 14:52:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:35.723 14:52:16 -- common/autotest_common.sh@10 -- # set +x 00:04:35.723 [2024-04-26 14:52:16.509907] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:35.723 request: 00:04:35.723 { 00:04:35.723 "trtype": "tcp", 00:04:35.723 "method": "nvmf_get_transports", 00:04:35.723 "req_id": 1 00:04:35.723 } 00:04:35.723 Got JSON-RPC error response 00:04:35.723 response: 00:04:35.723 { 00:04:35.723 "code": -19, 00:04:35.723 "message": "No such device" 00:04:35.723 } 00:04:35.723 14:52:16 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:04:35.723 14:52:16 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:35.723 14:52:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:35.723 14:52:16 -- common/autotest_common.sh@10 -- # set +x 00:04:35.723 [2024-04-26 14:52:16.522023] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:35.723 14:52:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:35.723 14:52:16 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:35.723 14:52:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:35.723 14:52:16 -- common/autotest_common.sh@10 -- # set +x 00:04:35.984 14:52:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:35.984 14:52:16 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:35.984 { 00:04:35.984 "subsystems": [ 00:04:35.984 { 00:04:35.984 "subsystem": "keyring", 00:04:35.984 "config": [] 00:04:35.984 }, 00:04:35.984 { 00:04:35.984 "subsystem": "iobuf", 00:04:35.984 "config": [ 00:04:35.984 { 00:04:35.984 "method": "iobuf_set_options", 00:04:35.984 "params": { 00:04:35.984 "small_pool_count": 8192, 00:04:35.984 "large_pool_count": 1024, 00:04:35.984 "small_bufsize": 8192, 00:04:35.984 "large_bufsize": 135168 00:04:35.984 } 00:04:35.984 } 00:04:35.984 ] 00:04:35.984 }, 00:04:35.984 { 00:04:35.984 "subsystem": "sock", 00:04:35.984 "config": [ 00:04:35.984 { 00:04:35.984 "method": "sock_impl_set_options", 00:04:35.984 "params": { 00:04:35.984 "impl_name": "posix", 00:04:35.984 "recv_buf_size": 2097152, 00:04:35.984 "send_buf_size": 2097152, 00:04:35.984 "enable_recv_pipe": true, 00:04:35.984 "enable_quickack": false, 00:04:35.984 "enable_placement_id": 0, 00:04:35.984 "enable_zerocopy_send_server": true, 00:04:35.984 "enable_zerocopy_send_client": false, 00:04:35.984 "zerocopy_threshold": 0, 00:04:35.984 "tls_version": 0, 00:04:35.984 "enable_ktls": false 00:04:35.984 } 00:04:35.984 }, 00:04:35.984 { 00:04:35.984 "method": "sock_impl_set_options", 00:04:35.984 "params": { 00:04:35.984 "impl_name": "ssl", 00:04:35.984 "recv_buf_size": 4096, 00:04:35.984 "send_buf_size": 4096, 00:04:35.984 "enable_recv_pipe": true, 00:04:35.984 "enable_quickack": false, 00:04:35.984 "enable_placement_id": 0, 00:04:35.984 "enable_zerocopy_send_server": true, 00:04:35.984 "enable_zerocopy_send_client": false, 00:04:35.984 "zerocopy_threshold": 0, 00:04:35.984 "tls_version": 0, 00:04:35.984 "enable_ktls": false 00:04:35.984 } 00:04:35.984 } 00:04:35.984 ] 00:04:35.984 }, 00:04:35.984 { 00:04:35.984 "subsystem": "vmd", 00:04:35.984 "config": [] 00:04:35.984 }, 00:04:35.984 { 00:04:35.984 "subsystem": "accel", 00:04:35.984 "config": [ 00:04:35.984 { 00:04:35.984 "method": "accel_set_options", 00:04:35.984 "params": { 00:04:35.984 "small_cache_size": 128, 00:04:35.984 "large_cache_size": 16, 00:04:35.985 "task_count": 2048, 00:04:35.985 "sequence_count": 2048, 00:04:35.985 "buf_count": 2048 00:04:35.985 } 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "bdev", 00:04:35.985 "config": [ 00:04:35.985 { 00:04:35.985 "method": "bdev_set_options", 00:04:35.985 "params": { 00:04:35.985 "bdev_io_pool_size": 65535, 00:04:35.985 "bdev_io_cache_size": 256, 00:04:35.985 "bdev_auto_examine": true, 00:04:35.985 "iobuf_small_cache_size": 128, 00:04:35.985 "iobuf_large_cache_size": 16 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "bdev_raid_set_options", 00:04:35.985 "params": { 00:04:35.985 "process_window_size_kb": 1024 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "bdev_iscsi_set_options", 00:04:35.985 "params": { 00:04:35.985 "timeout_sec": 30 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "bdev_nvme_set_options", 00:04:35.985 "params": { 00:04:35.985 "action_on_timeout": "none", 00:04:35.985 "timeout_us": 0, 00:04:35.985 "timeout_admin_us": 0, 00:04:35.985 "keep_alive_timeout_ms": 10000, 00:04:35.985 "arbitration_burst": 0, 00:04:35.985 "low_priority_weight": 0, 00:04:35.985 "medium_priority_weight": 0, 00:04:35.985 "high_priority_weight": 0, 00:04:35.985 "nvme_adminq_poll_period_us": 10000, 00:04:35.985 "nvme_ioq_poll_period_us": 0, 00:04:35.985 "io_queue_requests": 0, 00:04:35.985 "delay_cmd_submit": true, 00:04:35.985 "transport_retry_count": 4, 00:04:35.985 "bdev_retry_count": 3, 00:04:35.985 "transport_ack_timeout": 0, 00:04:35.985 "ctrlr_loss_timeout_sec": 0, 00:04:35.985 "reconnect_delay_sec": 0, 00:04:35.985 "fast_io_fail_timeout_sec": 0, 00:04:35.985 "disable_auto_failback": false, 00:04:35.985 "generate_uuids": false, 00:04:35.985 "transport_tos": 0, 00:04:35.985 "nvme_error_stat": false, 00:04:35.985 "rdma_srq_size": 0, 00:04:35.985 "io_path_stat": false, 00:04:35.985 "allow_accel_sequence": false, 00:04:35.985 "rdma_max_cq_size": 0, 00:04:35.985 "rdma_cm_event_timeout_ms": 0, 00:04:35.985 "dhchap_digests": [ 00:04:35.985 "sha256", 00:04:35.985 "sha384", 00:04:35.985 "sha512" 00:04:35.985 ], 00:04:35.985 "dhchap_dhgroups": [ 00:04:35.985 "null", 00:04:35.985 "ffdhe2048", 00:04:35.985 "ffdhe3072", 00:04:35.985 "ffdhe4096", 00:04:35.985 "ffdhe6144", 00:04:35.985 "ffdhe8192" 00:04:35.985 ] 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "bdev_nvme_set_hotplug", 00:04:35.985 "params": { 00:04:35.985 "period_us": 100000, 00:04:35.985 "enable": false 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "bdev_wait_for_examine" 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "scsi", 00:04:35.985 "config": null 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "scheduler", 00:04:35.985 "config": [ 00:04:35.985 { 00:04:35.985 "method": "framework_set_scheduler", 00:04:35.985 "params": { 00:04:35.985 "name": "static" 00:04:35.985 } 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "vhost_scsi", 00:04:35.985 "config": [] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "vhost_blk", 00:04:35.985 "config": [] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "ublk", 00:04:35.985 "config": [] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "nbd", 00:04:35.985 "config": [] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "nvmf", 00:04:35.985 "config": [ 00:04:35.985 { 00:04:35.985 "method": "nvmf_set_config", 00:04:35.985 "params": { 00:04:35.985 "discovery_filter": "match_any", 00:04:35.985 "admin_cmd_passthru": { 00:04:35.985 "identify_ctrlr": false 00:04:35.985 } 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "nvmf_set_max_subsystems", 00:04:35.985 "params": { 00:04:35.985 "max_subsystems": 1024 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "nvmf_set_crdt", 00:04:35.985 "params": { 00:04:35.985 "crdt1": 0, 00:04:35.985 "crdt2": 0, 00:04:35.985 "crdt3": 0 00:04:35.985 } 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "method": "nvmf_create_transport", 00:04:35.985 "params": { 00:04:35.985 "trtype": "TCP", 00:04:35.985 "max_queue_depth": 128, 00:04:35.985 "max_io_qpairs_per_ctrlr": 127, 00:04:35.985 "in_capsule_data_size": 4096, 00:04:35.985 "max_io_size": 131072, 00:04:35.985 "io_unit_size": 131072, 00:04:35.985 "max_aq_depth": 128, 00:04:35.985 "num_shared_buffers": 511, 00:04:35.985 "buf_cache_size": 4294967295, 00:04:35.985 "dif_insert_or_strip": false, 00:04:35.985 "zcopy": false, 00:04:35.985 "c2h_success": true, 00:04:35.985 "sock_priority": 0, 00:04:35.985 "abort_timeout_sec": 1, 00:04:35.985 "ack_timeout": 0, 00:04:35.985 "data_wr_pool_size": 0 00:04:35.985 } 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 }, 00:04:35.985 { 00:04:35.985 "subsystem": "iscsi", 00:04:35.985 "config": [ 00:04:35.985 { 00:04:35.985 "method": "iscsi_set_options", 00:04:35.985 "params": { 00:04:35.985 "node_base": "iqn.2016-06.io.spdk", 00:04:35.985 "max_sessions": 128, 00:04:35.985 "max_connections_per_session": 2, 00:04:35.985 "max_queue_depth": 64, 00:04:35.985 "default_time2wait": 2, 00:04:35.985 "default_time2retain": 20, 00:04:35.985 "first_burst_length": 8192, 00:04:35.985 "immediate_data": true, 00:04:35.985 "allow_duplicated_isid": false, 00:04:35.985 "error_recovery_level": 0, 00:04:35.985 "nop_timeout": 60, 00:04:35.985 "nop_in_interval": 30, 00:04:35.985 "disable_chap": false, 00:04:35.985 "require_chap": false, 00:04:35.985 "mutual_chap": false, 00:04:35.985 "chap_group": 0, 00:04:35.985 "max_large_datain_per_connection": 64, 00:04:35.985 "max_r2t_per_connection": 4, 00:04:35.985 "pdu_pool_size": 36864, 00:04:35.985 "immediate_data_pool_size": 16384, 00:04:35.985 "data_out_pool_size": 2048 00:04:35.985 } 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 } 00:04:35.985 ] 00:04:35.985 } 00:04:35.985 14:52:16 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:35.985 14:52:16 -- rpc/skip_rpc.sh@40 -- # killprocess 3306360 00:04:35.985 14:52:16 -- common/autotest_common.sh@946 -- # '[' -z 3306360 ']' 00:04:35.985 14:52:16 -- common/autotest_common.sh@950 -- # kill -0 3306360 00:04:35.985 14:52:16 -- common/autotest_common.sh@951 -- # uname 00:04:35.985 14:52:16 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:35.985 14:52:16 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3306360 00:04:35.985 14:52:16 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:35.985 14:52:16 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:35.985 14:52:16 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3306360' 00:04:35.985 killing process with pid 3306360 00:04:35.985 14:52:16 -- common/autotest_common.sh@965 -- # kill 3306360 00:04:35.985 14:52:16 -- common/autotest_common.sh@970 -- # wait 3306360 00:04:36.246 14:52:16 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=3306508 00:04:36.246 14:52:16 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:36.246 14:52:16 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:41.535 14:52:21 -- rpc/skip_rpc.sh@50 -- # killprocess 3306508 00:04:41.535 14:52:21 -- common/autotest_common.sh@946 -- # '[' -z 3306508 ']' 00:04:41.535 14:52:21 -- common/autotest_common.sh@950 -- # kill -0 3306508 00:04:41.535 14:52:21 -- common/autotest_common.sh@951 -- # uname 00:04:41.535 14:52:21 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:41.535 14:52:21 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3306508 00:04:41.535 14:52:21 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:41.535 14:52:22 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:41.535 14:52:22 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3306508' 00:04:41.535 killing process with pid 3306508 00:04:41.535 14:52:22 -- common/autotest_common.sh@965 -- # kill 3306508 00:04:41.535 14:52:22 -- common/autotest_common.sh@970 -- # wait 3306508 00:04:41.535 14:52:22 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:41.535 14:52:22 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:41.535 00:04:41.535 real 0m6.524s 00:04:41.535 user 0m6.403s 00:04:41.535 sys 0m0.524s 00:04:41.535 14:52:22 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:41.535 14:52:22 -- common/autotest_common.sh@10 -- # set +x 00:04:41.535 ************************************ 00:04:41.535 END TEST skip_rpc_with_json 00:04:41.535 ************************************ 00:04:41.535 14:52:22 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:04:41.535 14:52:22 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:41.535 14:52:22 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:41.535 14:52:22 -- common/autotest_common.sh@10 -- # set +x 00:04:41.535 ************************************ 00:04:41.535 START TEST skip_rpc_with_delay 00:04:41.535 ************************************ 00:04:41.535 14:52:22 -- common/autotest_common.sh@1121 -- # test_skip_rpc_with_delay 00:04:41.535 14:52:22 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:41.535 14:52:22 -- common/autotest_common.sh@648 -- # local es=0 00:04:41.535 14:52:22 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:41.535 14:52:22 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.535 14:52:22 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:41.535 14:52:22 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.535 14:52:22 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:41.535 14:52:22 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.535 14:52:22 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:41.535 14:52:22 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:41.535 14:52:22 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:41.535 14:52:22 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:41.535 [2024-04-26 14:52:22.427090] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:04:41.535 [2024-04-26 14:52:22.427162] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:04:41.536 14:52:22 -- common/autotest_common.sh@651 -- # es=1 00:04:41.536 14:52:22 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:04:41.536 14:52:22 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:04:41.536 14:52:22 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:04:41.536 00:04:41.536 real 0m0.067s 00:04:41.536 user 0m0.046s 00:04:41.536 sys 0m0.021s 00:04:41.536 14:52:22 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:41.536 14:52:22 -- common/autotest_common.sh@10 -- # set +x 00:04:41.536 ************************************ 00:04:41.536 END TEST skip_rpc_with_delay 00:04:41.536 ************************************ 00:04:41.536 14:52:22 -- rpc/skip_rpc.sh@77 -- # uname 00:04:41.536 14:52:22 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:04:41.536 14:52:22 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:04:41.536 14:52:22 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:41.536 14:52:22 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:41.536 14:52:22 -- common/autotest_common.sh@10 -- # set +x 00:04:41.798 ************************************ 00:04:41.798 START TEST exit_on_failed_rpc_init 00:04:41.798 ************************************ 00:04:41.798 14:52:22 -- common/autotest_common.sh@1121 -- # test_exit_on_failed_rpc_init 00:04:41.798 14:52:22 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=3307783 00:04:41.798 14:52:22 -- rpc/skip_rpc.sh@63 -- # waitforlisten 3307783 00:04:41.798 14:52:22 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:41.798 14:52:22 -- common/autotest_common.sh@827 -- # '[' -z 3307783 ']' 00:04:41.798 14:52:22 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:41.798 14:52:22 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:41.798 14:52:22 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:41.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:41.798 14:52:22 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:41.798 14:52:22 -- common/autotest_common.sh@10 -- # set +x 00:04:41.798 [2024-04-26 14:52:22.662439] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:41.798 [2024-04-26 14:52:22.662498] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3307783 ] 00:04:41.798 EAL: No free 2048 kB hugepages reported on node 1 00:04:41.798 [2024-04-26 14:52:22.725870] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.060 [2024-04-26 14:52:22.798502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.632 14:52:23 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:42.632 14:52:23 -- common/autotest_common.sh@860 -- # return 0 00:04:42.632 14:52:23 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:42.632 14:52:23 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:42.632 14:52:23 -- common/autotest_common.sh@648 -- # local es=0 00:04:42.632 14:52:23 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:42.632 14:52:23 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:42.632 14:52:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:42.632 14:52:23 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:42.632 14:52:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:42.632 14:52:23 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:42.632 14:52:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:04:42.632 14:52:23 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:42.632 14:52:23 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:42.632 14:52:23 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:42.632 [2024-04-26 14:52:23.493299] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:42.632 [2024-04-26 14:52:23.493349] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3307820 ] 00:04:42.632 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.632 [2024-04-26 14:52:23.550595] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.893 [2024-04-26 14:52:23.612914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.893 [2024-04-26 14:52:23.612973] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:04:42.893 [2024-04-26 14:52:23.612983] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:04:42.893 [2024-04-26 14:52:23.612990] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:42.893 14:52:23 -- common/autotest_common.sh@651 -- # es=234 00:04:42.893 14:52:23 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:04:42.893 14:52:23 -- common/autotest_common.sh@660 -- # es=106 00:04:42.893 14:52:23 -- common/autotest_common.sh@661 -- # case "$es" in 00:04:42.893 14:52:23 -- common/autotest_common.sh@668 -- # es=1 00:04:42.893 14:52:23 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:04:42.893 14:52:23 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:04:42.893 14:52:23 -- rpc/skip_rpc.sh@70 -- # killprocess 3307783 00:04:42.893 14:52:23 -- common/autotest_common.sh@946 -- # '[' -z 3307783 ']' 00:04:42.893 14:52:23 -- common/autotest_common.sh@950 -- # kill -0 3307783 00:04:42.893 14:52:23 -- common/autotest_common.sh@951 -- # uname 00:04:42.893 14:52:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:42.893 14:52:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3307783 00:04:42.893 14:52:23 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:42.893 14:52:23 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:42.893 14:52:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3307783' 00:04:42.893 killing process with pid 3307783 00:04:42.893 14:52:23 -- common/autotest_common.sh@965 -- # kill 3307783 00:04:42.893 14:52:23 -- common/autotest_common.sh@970 -- # wait 3307783 00:04:43.153 00:04:43.153 real 0m1.322s 00:04:43.153 user 0m1.542s 00:04:43.153 sys 0m0.368s 00:04:43.153 14:52:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:43.153 14:52:23 -- common/autotest_common.sh@10 -- # set +x 00:04:43.153 ************************************ 00:04:43.153 END TEST exit_on_failed_rpc_init 00:04:43.153 ************************************ 00:04:43.153 14:52:23 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:43.153 00:04:43.153 real 0m13.978s 00:04:43.153 user 0m13.372s 00:04:43.153 sys 0m1.595s 00:04:43.153 14:52:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:43.153 14:52:23 -- common/autotest_common.sh@10 -- # set +x 00:04:43.153 ************************************ 00:04:43.153 END TEST skip_rpc 00:04:43.153 ************************************ 00:04:43.153 14:52:24 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:43.153 14:52:24 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:43.153 14:52:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:43.153 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.413 ************************************ 00:04:43.413 START TEST rpc_client 00:04:43.413 ************************************ 00:04:43.413 14:52:24 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:43.413 * Looking for test storage... 00:04:43.413 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:04:43.413 14:52:24 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:43.413 OK 00:04:43.413 14:52:24 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:43.413 00:04:43.413 real 0m0.125s 00:04:43.413 user 0m0.061s 00:04:43.413 sys 0m0.070s 00:04:43.413 14:52:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:43.413 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.413 ************************************ 00:04:43.413 END TEST rpc_client 00:04:43.413 ************************************ 00:04:43.413 14:52:24 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:04:43.413 14:52:24 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:43.413 14:52:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:43.413 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.673 ************************************ 00:04:43.673 START TEST json_config 00:04:43.673 ************************************ 00:04:43.673 14:52:24 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:04:43.673 14:52:24 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:04:43.673 14:52:24 -- nvmf/common.sh@7 -- # uname -s 00:04:43.673 14:52:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:43.673 14:52:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:43.673 14:52:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:43.673 14:52:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:43.673 14:52:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:43.673 14:52:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:43.673 14:52:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:43.673 14:52:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:43.673 14:52:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:43.673 14:52:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:43.674 14:52:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:43.674 14:52:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:43.674 14:52:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:43.674 14:52:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:43.674 14:52:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:43.674 14:52:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:43.674 14:52:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:04:43.674 14:52:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:43.674 14:52:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:43.674 14:52:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:43.674 14:52:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.674 14:52:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.674 14:52:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.674 14:52:24 -- paths/export.sh@5 -- # export PATH 00:04:43.674 14:52:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.674 14:52:24 -- nvmf/common.sh@47 -- # : 0 00:04:43.674 14:52:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:43.674 14:52:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:43.674 14:52:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:43.674 14:52:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:43.674 14:52:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:43.674 14:52:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:43.674 14:52:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:43.674 14:52:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:43.674 14:52:24 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:04:43.674 14:52:24 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:04:43.674 14:52:24 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:04:43.674 14:52:24 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:04:43.674 14:52:24 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:43.674 14:52:24 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:04:43.674 14:52:24 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:04:43.674 14:52:24 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:43.674 14:52:24 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:04:43.674 14:52:24 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:43.674 14:52:24 -- json_config/json_config.sh@33 -- # declare -A app_params 00:04:43.674 14:52:24 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:04:43.674 14:52:24 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:04:43.674 14:52:24 -- json_config/json_config.sh@40 -- # last_event_id=0 00:04:43.674 14:52:24 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:43.674 14:52:24 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:04:43.674 INFO: JSON configuration test init 00:04:43.674 14:52:24 -- json_config/json_config.sh@357 -- # json_config_test_init 00:04:43.674 14:52:24 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:04:43.674 14:52:24 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:43.674 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.674 14:52:24 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:04:43.674 14:52:24 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:43.674 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.674 14:52:24 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:04:43.674 14:52:24 -- json_config/common.sh@9 -- # local app=target 00:04:43.674 14:52:24 -- json_config/common.sh@10 -- # shift 00:04:43.674 14:52:24 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:43.674 14:52:24 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:43.674 14:52:24 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:43.674 14:52:24 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:43.674 14:52:24 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:43.674 14:52:24 -- json_config/common.sh@22 -- # app_pid["$app"]=3308254 00:04:43.674 14:52:24 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:43.674 Waiting for target to run... 00:04:43.674 14:52:24 -- json_config/common.sh@25 -- # waitforlisten 3308254 /var/tmp/spdk_tgt.sock 00:04:43.674 14:52:24 -- common/autotest_common.sh@827 -- # '[' -z 3308254 ']' 00:04:43.674 14:52:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:43.674 14:52:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:43.674 14:52:24 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:43.674 14:52:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:43.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:43.674 14:52:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:43.674 14:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.934 [2024-04-26 14:52:24.626444] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:43.934 [2024-04-26 14:52:24.626517] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3308254 ] 00:04:43.934 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.195 [2024-04-26 14:52:24.948567] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.195 [2024-04-26 14:52:24.998332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.456 14:52:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:44.456 14:52:25 -- common/autotest_common.sh@860 -- # return 0 00:04:44.456 14:52:25 -- json_config/common.sh@26 -- # echo '' 00:04:44.456 00:04:44.456 14:52:25 -- json_config/json_config.sh@269 -- # create_accel_config 00:04:44.456 14:52:25 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:04:44.456 14:52:25 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:44.456 14:52:25 -- common/autotest_common.sh@10 -- # set +x 00:04:44.456 14:52:25 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:04:44.456 14:52:25 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:04:44.456 14:52:25 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:44.456 14:52:25 -- common/autotest_common.sh@10 -- # set +x 00:04:44.716 14:52:25 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:44.716 14:52:25 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:04:44.716 14:52:25 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:45.287 14:52:25 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:04:45.287 14:52:25 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:04:45.288 14:52:25 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:45.288 14:52:25 -- common/autotest_common.sh@10 -- # set +x 00:04:45.288 14:52:25 -- json_config/json_config.sh@45 -- # local ret=0 00:04:45.288 14:52:25 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:45.288 14:52:25 -- json_config/json_config.sh@46 -- # local enabled_types 00:04:45.288 14:52:25 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:04:45.288 14:52:25 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:45.288 14:52:25 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:04:45.288 14:52:26 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:45.288 14:52:26 -- json_config/json_config.sh@48 -- # local get_types 00:04:45.288 14:52:26 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:04:45.288 14:52:26 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:45.288 14:52:26 -- common/autotest_common.sh@10 -- # set +x 00:04:45.288 14:52:26 -- json_config/json_config.sh@55 -- # return 0 00:04:45.288 14:52:26 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:04:45.288 14:52:26 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:04:45.288 14:52:26 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:45.288 14:52:26 -- common/autotest_common.sh@10 -- # set +x 00:04:45.288 14:52:26 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:45.288 14:52:26 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:04:45.288 14:52:26 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:04:45.288 14:52:26 -- json_config/json_config.sh@234 -- # nvmftestinit 00:04:45.288 14:52:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:04:45.288 14:52:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:04:45.288 14:52:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:04:45.288 14:52:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:04:45.288 14:52:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:04:45.288 14:52:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:04:45.288 14:52:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:04:45.288 14:52:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:04:45.288 14:52:26 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:04:45.288 14:52:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:04:45.288 14:52:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:04:45.288 14:52:26 -- common/autotest_common.sh@10 -- # set +x 00:04:51.878 14:52:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:04:51.878 14:52:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:04:51.878 14:52:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:04:51.878 14:52:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:04:51.878 14:52:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:04:51.878 14:52:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:04:51.878 14:52:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:04:51.878 14:52:32 -- nvmf/common.sh@295 -- # net_devs=() 00:04:51.878 14:52:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:04:51.878 14:52:32 -- nvmf/common.sh@296 -- # e810=() 00:04:51.878 14:52:32 -- nvmf/common.sh@296 -- # local -ga e810 00:04:51.878 14:52:32 -- nvmf/common.sh@297 -- # x722=() 00:04:51.878 14:52:32 -- nvmf/common.sh@297 -- # local -ga x722 00:04:51.878 14:52:32 -- nvmf/common.sh@298 -- # mlx=() 00:04:51.878 14:52:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:04:51.878 14:52:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:04:51.878 14:52:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:04:51.878 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:04:51.878 14:52:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:51.878 14:52:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:04:51.878 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:04:51.878 14:52:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:51.878 14:52:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:51.878 14:52:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:51.878 14:52:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:04:51.878 Found net devices under 0000:31:00.0: mlx_0_0 00:04:51.878 14:52:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:51.878 14:52:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:51.878 14:52:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:04:51.878 Found net devices under 0000:31:00.1: mlx_0_1 00:04:51.878 14:52:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:51.878 14:52:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:04:51.878 14:52:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@409 -- # rdma_device_init 00:04:51.878 14:52:32 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:04:51.878 14:52:32 -- nvmf/common.sh@58 -- # uname 00:04:51.878 14:52:32 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:04:51.878 14:52:32 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:04:51.878 14:52:32 -- nvmf/common.sh@63 -- # modprobe ib_core 00:04:51.878 14:52:32 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:04:51.878 14:52:32 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:04:51.878 14:52:32 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:04:51.878 14:52:32 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:04:51.878 14:52:32 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:04:51.878 14:52:32 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:04:51.878 14:52:32 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:04:51.878 14:52:32 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:04:51.878 14:52:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:51.878 14:52:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:51.878 14:52:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:51.878 14:52:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:51.878 14:52:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:51.878 14:52:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:04:51.878 14:52:32 -- nvmf/common.sh@105 -- # continue 2 00:04:51.878 14:52:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.878 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:04:51.878 14:52:32 -- nvmf/common.sh@105 -- # continue 2 00:04:51.878 14:52:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:51.878 14:52:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:04:51.878 14:52:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:04:51.878 14:52:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:51.878 14:52:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:04:51.878 14:52:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:51.878 14:52:32 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:04:51.878 14:52:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:04:51.878 14:52:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:04:51.878 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:04:51.878 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:04:51.878 altname enp49s0f0np0 00:04:51.878 altname ens786f0np0 00:04:51.878 inet 192.168.100.8/24 scope global mlx_0_0 00:04:51.878 valid_lft forever preferred_lft forever 00:04:51.878 14:52:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:51.878 14:52:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:51.879 14:52:32 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:04:51.879 14:52:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:04:51.879 14:52:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:04:51.879 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:04:51.879 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:04:51.879 altname enp49s0f1np1 00:04:51.879 altname ens786f1np1 00:04:51.879 inet 192.168.100.9/24 scope global mlx_0_1 00:04:51.879 valid_lft forever preferred_lft forever 00:04:51.879 14:52:32 -- nvmf/common.sh@411 -- # return 0 00:04:51.879 14:52:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:04:51.879 14:52:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:04:51.879 14:52:32 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:04:51.879 14:52:32 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:04:51.879 14:52:32 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:04:51.879 14:52:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:51.879 14:52:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:51.879 14:52:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:51.879 14:52:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:51.879 14:52:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:51.879 14:52:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:51.879 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.879 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:04:51.879 14:52:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:04:51.879 14:52:32 -- nvmf/common.sh@105 -- # continue 2 00:04:51.879 14:52:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:51.879 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.879 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:04:51.879 14:52:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:51.879 14:52:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:04:51.879 14:52:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@105 -- # continue 2 00:04:51.879 14:52:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:51.879 14:52:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:04:51.879 14:52:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:51.879 14:52:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:51.879 14:52:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:51.879 14:52:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:51.879 14:52:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:04:51.879 192.168.100.9' 00:04:51.879 14:52:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:04:51.879 192.168.100.9' 00:04:51.879 14:52:32 -- nvmf/common.sh@446 -- # head -n 1 00:04:51.879 14:52:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:04:51.879 14:52:32 -- nvmf/common.sh@447 -- # head -n 1 00:04:51.879 14:52:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:04:51.879 192.168.100.9' 00:04:51.879 14:52:32 -- nvmf/common.sh@447 -- # tail -n +2 00:04:52.141 14:52:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:04:52.141 14:52:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:04:52.141 14:52:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:04:52.141 14:52:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:04:52.141 14:52:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:04:52.141 14:52:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:04:52.141 14:52:32 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:04:52.141 14:52:32 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:52.141 14:52:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:52.141 MallocForNvmf0 00:04:52.141 14:52:33 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:52.141 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:52.403 MallocForNvmf1 00:04:52.403 14:52:33 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:04:52.403 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:04:52.403 [2024-04-26 14:52:33.311643] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:04:52.403 [2024-04-26 14:52:33.344532] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb8fad0/0xbbc940) succeed. 00:04:52.664 [2024-04-26 14:52:33.358361] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb91cc0/0xc1c900) succeed. 00:04:52.664 14:52:33 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:52.664 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:52.664 14:52:33 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:52.664 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:52.924 14:52:33 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:52.924 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:52.924 14:52:33 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:52.924 14:52:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:53.185 [2024-04-26 14:52:33.991319] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:53.185 14:52:34 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:04:53.185 14:52:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:53.185 14:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:53.185 14:52:34 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:04:53.185 14:52:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:53.185 14:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:53.185 14:52:34 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:04:53.185 14:52:34 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:53.185 14:52:34 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:53.445 MallocBdevForConfigChangeCheck 00:04:53.445 14:52:34 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:04:53.445 14:52:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:53.445 14:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:53.445 14:52:34 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:04:53.445 14:52:34 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:53.705 14:52:34 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:04:53.705 INFO: shutting down applications... 00:04:53.705 14:52:34 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:04:53.705 14:52:34 -- json_config/json_config.sh@368 -- # json_config_clear target 00:04:53.705 14:52:34 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:04:53.705 14:52:34 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:54.276 Calling clear_iscsi_subsystem 00:04:54.276 Calling clear_nvmf_subsystem 00:04:54.276 Calling clear_nbd_subsystem 00:04:54.276 Calling clear_ublk_subsystem 00:04:54.276 Calling clear_vhost_blk_subsystem 00:04:54.276 Calling clear_vhost_scsi_subsystem 00:04:54.276 Calling clear_bdev_subsystem 00:04:54.276 14:52:34 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:04:54.276 14:52:34 -- json_config/json_config.sh@343 -- # count=100 00:04:54.276 14:52:34 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:04:54.276 14:52:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:54.276 14:52:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:54.276 14:52:34 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:54.536 14:52:35 -- json_config/json_config.sh@345 -- # break 00:04:54.536 14:52:35 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:04:54.536 14:52:35 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:04:54.536 14:52:35 -- json_config/common.sh@31 -- # local app=target 00:04:54.536 14:52:35 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:54.536 14:52:35 -- json_config/common.sh@35 -- # [[ -n 3308254 ]] 00:04:54.536 14:52:35 -- json_config/common.sh@38 -- # kill -SIGINT 3308254 00:04:54.536 14:52:35 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:54.536 14:52:35 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:54.536 14:52:35 -- json_config/common.sh@41 -- # kill -0 3308254 00:04:54.536 14:52:35 -- json_config/common.sh@45 -- # sleep 0.5 00:04:54.536 [2024-04-26 14:52:35.364366] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:55.107 14:52:35 -- json_config/common.sh@40 -- # (( i++ )) 00:04:55.107 14:52:35 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:55.107 14:52:35 -- json_config/common.sh@41 -- # kill -0 3308254 00:04:55.107 14:52:35 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:55.107 14:52:35 -- json_config/common.sh@43 -- # break 00:04:55.107 14:52:35 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:55.107 14:52:35 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:55.107 SPDK target shutdown done 00:04:55.107 14:52:35 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:04:55.107 INFO: relaunching applications... 00:04:55.107 14:52:35 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:55.107 14:52:35 -- json_config/common.sh@9 -- # local app=target 00:04:55.107 14:52:35 -- json_config/common.sh@10 -- # shift 00:04:55.107 14:52:35 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:55.107 14:52:35 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:55.107 14:52:35 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:55.107 14:52:35 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:55.107 14:52:35 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:55.107 14:52:35 -- json_config/common.sh@22 -- # app_pid["$app"]=3312973 00:04:55.107 14:52:35 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:55.107 Waiting for target to run... 00:04:55.107 14:52:35 -- json_config/common.sh@25 -- # waitforlisten 3312973 /var/tmp/spdk_tgt.sock 00:04:55.107 14:52:35 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:55.107 14:52:35 -- common/autotest_common.sh@827 -- # '[' -z 3312973 ']' 00:04:55.107 14:52:35 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:55.107 14:52:35 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:55.107 14:52:35 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:55.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:55.107 14:52:35 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:55.107 14:52:35 -- common/autotest_common.sh@10 -- # set +x 00:04:55.107 [2024-04-26 14:52:35.837666] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:55.107 [2024-04-26 14:52:35.837725] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3312973 ] 00:04:55.107 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.368 [2024-04-26 14:52:36.105691] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.368 [2024-04-26 14:52:36.160967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.940 [2024-04-26 14:52:36.680517] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x23c0c30/0x2346fc0) succeed. 00:04:55.940 [2024-04-26 14:52:36.693781] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x23bfc20/0x22c6f80) succeed. 00:04:55.940 [2024-04-26 14:52:36.748790] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:55.940 14:52:36 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:55.940 14:52:36 -- common/autotest_common.sh@860 -- # return 0 00:04:55.940 14:52:36 -- json_config/common.sh@26 -- # echo '' 00:04:55.940 00:04:55.940 14:52:36 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:04:55.940 14:52:36 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:55.940 INFO: Checking if target configuration is the same... 00:04:55.940 14:52:36 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:55.940 14:52:36 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:04:55.940 14:52:36 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:55.940 + '[' 2 -ne 2 ']' 00:04:55.940 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:55.940 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:04:55.940 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:04:55.940 +++ basename /dev/fd/62 00:04:55.940 ++ mktemp /tmp/62.XXX 00:04:55.940 + tmp_file_1=/tmp/62.J60 00:04:55.940 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:55.940 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:55.940 + tmp_file_2=/tmp/spdk_tgt_config.json.wFy 00:04:55.940 + ret=0 00:04:55.940 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:56.201 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:56.201 + diff -u /tmp/62.J60 /tmp/spdk_tgt_config.json.wFy 00:04:56.201 + echo 'INFO: JSON config files are the same' 00:04:56.201 INFO: JSON config files are the same 00:04:56.201 + rm /tmp/62.J60 /tmp/spdk_tgt_config.json.wFy 00:04:56.201 + exit 0 00:04:56.201 14:52:37 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:04:56.201 14:52:37 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:56.201 INFO: changing configuration and checking if this can be detected... 00:04:56.201 14:52:37 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:56.201 14:52:37 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:56.463 14:52:37 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:04:56.463 14:52:37 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:56.463 14:52:37 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:56.463 + '[' 2 -ne 2 ']' 00:04:56.463 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:56.463 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:04:56.463 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:04:56.463 +++ basename /dev/fd/62 00:04:56.463 ++ mktemp /tmp/62.XXX 00:04:56.463 + tmp_file_1=/tmp/62.4YN 00:04:56.463 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:56.463 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:56.463 + tmp_file_2=/tmp/spdk_tgt_config.json.brh 00:04:56.463 + ret=0 00:04:56.463 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:56.723 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:56.723 + diff -u /tmp/62.4YN /tmp/spdk_tgt_config.json.brh 00:04:56.723 + ret=1 00:04:56.723 + echo '=== Start of file: /tmp/62.4YN ===' 00:04:56.723 + cat /tmp/62.4YN 00:04:56.723 + echo '=== End of file: /tmp/62.4YN ===' 00:04:56.723 + echo '' 00:04:56.724 + echo '=== Start of file: /tmp/spdk_tgt_config.json.brh ===' 00:04:56.724 + cat /tmp/spdk_tgt_config.json.brh 00:04:56.724 + echo '=== End of file: /tmp/spdk_tgt_config.json.brh ===' 00:04:56.724 + echo '' 00:04:56.724 + rm /tmp/62.4YN /tmp/spdk_tgt_config.json.brh 00:04:56.724 + exit 1 00:04:56.724 14:52:37 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:04:56.724 INFO: configuration change detected. 00:04:56.724 14:52:37 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:04:56.724 14:52:37 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:04:56.724 14:52:37 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:56.724 14:52:37 -- common/autotest_common.sh@10 -- # set +x 00:04:56.724 14:52:37 -- json_config/json_config.sh@307 -- # local ret=0 00:04:56.724 14:52:37 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:04:56.724 14:52:37 -- json_config/json_config.sh@317 -- # [[ -n 3312973 ]] 00:04:56.724 14:52:37 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:04:56.724 14:52:37 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:04:56.724 14:52:37 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:56.724 14:52:37 -- common/autotest_common.sh@10 -- # set +x 00:04:56.724 14:52:37 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:04:56.724 14:52:37 -- json_config/json_config.sh@193 -- # uname -s 00:04:56.724 14:52:37 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:04:56.724 14:52:37 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:04:57.057 14:52:37 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:04:57.057 14:52:37 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:04:57.057 14:52:37 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:57.057 14:52:37 -- common/autotest_common.sh@10 -- # set +x 00:04:57.057 14:52:37 -- json_config/json_config.sh@323 -- # killprocess 3312973 00:04:57.057 14:52:37 -- common/autotest_common.sh@946 -- # '[' -z 3312973 ']' 00:04:57.057 14:52:37 -- common/autotest_common.sh@950 -- # kill -0 3312973 00:04:57.057 14:52:37 -- common/autotest_common.sh@951 -- # uname 00:04:57.057 14:52:37 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:57.057 14:52:37 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3312973 00:04:57.057 14:52:37 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:57.057 14:52:37 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:57.057 14:52:37 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3312973' 00:04:57.057 killing process with pid 3312973 00:04:57.057 14:52:37 -- common/autotest_common.sh@965 -- # kill 3312973 00:04:57.057 14:52:37 -- common/autotest_common.sh@970 -- # wait 3312973 00:04:57.057 [2024-04-26 14:52:37.858051] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:57.334 14:52:38 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:57.334 14:52:38 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:04:57.334 14:52:38 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:57.334 14:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:57.334 14:52:38 -- json_config/json_config.sh@328 -- # return 0 00:04:57.334 14:52:38 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:04:57.334 INFO: Success 00:04:57.334 14:52:38 -- json_config/json_config.sh@1 -- # nvmftestfini 00:04:57.334 14:52:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:04:57.334 14:52:38 -- nvmf/common.sh@117 -- # sync 00:04:57.334 14:52:38 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:04:57.334 14:52:38 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:04:57.334 14:52:38 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:04:57.334 14:52:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:04:57.334 14:52:38 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:04:57.334 00:04:57.334 real 0m13.703s 00:04:57.334 user 0m16.959s 00:04:57.334 sys 0m6.623s 00:04:57.334 14:52:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:57.334 14:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:57.334 ************************************ 00:04:57.334 END TEST json_config 00:04:57.334 ************************************ 00:04:57.334 14:52:38 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:57.334 14:52:38 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:57.334 14:52:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:57.334 14:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:57.596 ************************************ 00:04:57.596 START TEST json_config_extra_key 00:04:57.596 ************************************ 00:04:57.596 14:52:38 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:04:57.596 14:52:38 -- nvmf/common.sh@7 -- # uname -s 00:04:57.596 14:52:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:57.596 14:52:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:57.596 14:52:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:57.596 14:52:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:57.596 14:52:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:57.596 14:52:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:57.596 14:52:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:57.596 14:52:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:57.596 14:52:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:57.596 14:52:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:57.596 14:52:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:57.596 14:52:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:04:57.596 14:52:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:57.596 14:52:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:57.596 14:52:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:57.596 14:52:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:57.596 14:52:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:04:57.596 14:52:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:57.596 14:52:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:57.596 14:52:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:57.596 14:52:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:57.596 14:52:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:57.596 14:52:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:57.596 14:52:38 -- paths/export.sh@5 -- # export PATH 00:04:57.596 14:52:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:57.596 14:52:38 -- nvmf/common.sh@47 -- # : 0 00:04:57.596 14:52:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:57.596 14:52:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:57.596 14:52:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:57.596 14:52:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:57.596 14:52:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:57.596 14:52:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:57.596 14:52:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:57.596 14:52:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:04:57.596 INFO: launching applications... 00:04:57.596 14:52:38 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:04:57.596 14:52:38 -- json_config/common.sh@9 -- # local app=target 00:04:57.597 14:52:38 -- json_config/common.sh@10 -- # shift 00:04:57.597 14:52:38 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:57.597 14:52:38 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:57.597 14:52:38 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:57.597 14:52:38 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:57.597 14:52:38 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:57.597 14:52:38 -- json_config/common.sh@22 -- # app_pid["$app"]=3313522 00:04:57.597 14:52:38 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:57.597 Waiting for target to run... 00:04:57.597 14:52:38 -- json_config/common.sh@25 -- # waitforlisten 3313522 /var/tmp/spdk_tgt.sock 00:04:57.597 14:52:38 -- common/autotest_common.sh@827 -- # '[' -z 3313522 ']' 00:04:57.597 14:52:38 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:57.597 14:52:38 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:57.597 14:52:38 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:04:57.597 14:52:38 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:57.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:57.597 14:52:38 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:57.597 14:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:57.597 [2024-04-26 14:52:38.497871] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:57.597 [2024-04-26 14:52:38.497937] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3313522 ] 00:04:57.597 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.169 [2024-04-26 14:52:38.929646] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.169 [2024-04-26 14:52:38.989667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.429 14:52:39 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:58.429 14:52:39 -- common/autotest_common.sh@860 -- # return 0 00:04:58.429 14:52:39 -- json_config/common.sh@26 -- # echo '' 00:04:58.429 00:04:58.429 14:52:39 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:04:58.429 INFO: shutting down applications... 00:04:58.429 14:52:39 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:04:58.429 14:52:39 -- json_config/common.sh@31 -- # local app=target 00:04:58.429 14:52:39 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:58.429 14:52:39 -- json_config/common.sh@35 -- # [[ -n 3313522 ]] 00:04:58.429 14:52:39 -- json_config/common.sh@38 -- # kill -SIGINT 3313522 00:04:58.429 14:52:39 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:58.429 14:52:39 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:58.429 14:52:39 -- json_config/common.sh@41 -- # kill -0 3313522 00:04:58.429 14:52:39 -- json_config/common.sh@45 -- # sleep 0.5 00:04:58.999 14:52:39 -- json_config/common.sh@40 -- # (( i++ )) 00:04:58.999 14:52:39 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:58.999 14:52:39 -- json_config/common.sh@41 -- # kill -0 3313522 00:04:58.999 14:52:39 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:58.999 14:52:39 -- json_config/common.sh@43 -- # break 00:04:58.999 14:52:39 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:58.999 14:52:39 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:58.999 SPDK target shutdown done 00:04:58.999 14:52:39 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:04:58.999 Success 00:04:58.999 00:04:58.999 real 0m1.445s 00:04:58.999 user 0m0.943s 00:04:58.999 sys 0m0.508s 00:04:58.999 14:52:39 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:58.999 14:52:39 -- common/autotest_common.sh@10 -- # set +x 00:04:58.999 ************************************ 00:04:58.999 END TEST json_config_extra_key 00:04:58.999 ************************************ 00:04:58.999 14:52:39 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:58.999 14:52:39 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:58.999 14:52:39 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:58.999 14:52:39 -- common/autotest_common.sh@10 -- # set +x 00:04:58.999 ************************************ 00:04:58.999 START TEST alias_rpc 00:04:58.999 ************************************ 00:04:58.999 14:52:39 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:59.260 * Looking for test storage... 00:04:59.260 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:04:59.260 14:52:40 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:59.260 14:52:40 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3313861 00:04:59.260 14:52:40 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3313861 00:04:59.260 14:52:40 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:59.260 14:52:40 -- common/autotest_common.sh@827 -- # '[' -z 3313861 ']' 00:04:59.260 14:52:40 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.260 14:52:40 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:59.260 14:52:40 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.260 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.260 14:52:40 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:59.260 14:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:59.260 [2024-04-26 14:52:40.099356] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:04:59.260 [2024-04-26 14:52:40.099419] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3313861 ] 00:04:59.260 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.260 [2024-04-26 14:52:40.162734] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.522 [2024-04-26 14:52:40.232477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.094 14:52:40 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:00.094 14:52:40 -- common/autotest_common.sh@860 -- # return 0 00:05:00.094 14:52:40 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:00.355 14:52:41 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3313861 00:05:00.355 14:52:41 -- common/autotest_common.sh@946 -- # '[' -z 3313861 ']' 00:05:00.355 14:52:41 -- common/autotest_common.sh@950 -- # kill -0 3313861 00:05:00.355 14:52:41 -- common/autotest_common.sh@951 -- # uname 00:05:00.355 14:52:41 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:00.355 14:52:41 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3313861 00:05:00.355 14:52:41 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:00.355 14:52:41 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:00.355 14:52:41 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3313861' 00:05:00.355 killing process with pid 3313861 00:05:00.355 14:52:41 -- common/autotest_common.sh@965 -- # kill 3313861 00:05:00.355 14:52:41 -- common/autotest_common.sh@970 -- # wait 3313861 00:05:00.616 00:05:00.616 real 0m1.378s 00:05:00.616 user 0m1.525s 00:05:00.616 sys 0m0.363s 00:05:00.616 14:52:41 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:00.616 14:52:41 -- common/autotest_common.sh@10 -- # set +x 00:05:00.616 ************************************ 00:05:00.616 END TEST alias_rpc 00:05:00.616 ************************************ 00:05:00.616 14:52:41 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:05:00.616 14:52:41 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:00.616 14:52:41 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:00.616 14:52:41 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:00.616 14:52:41 -- common/autotest_common.sh@10 -- # set +x 00:05:00.616 ************************************ 00:05:00.616 START TEST spdkcli_tcp 00:05:00.616 ************************************ 00:05:00.616 14:52:41 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:00.877 * Looking for test storage... 00:05:00.877 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:05:00.877 14:52:41 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:00.877 14:52:41 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:00.877 14:52:41 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:00.877 14:52:41 -- common/autotest_common.sh@10 -- # set +x 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3314239 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@27 -- # waitforlisten 3314239 00:05:00.877 14:52:41 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:00.877 14:52:41 -- common/autotest_common.sh@827 -- # '[' -z 3314239 ']' 00:05:00.877 14:52:41 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:00.878 14:52:41 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:00.878 14:52:41 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:00.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:00.878 14:52:41 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:00.878 14:52:41 -- common/autotest_common.sh@10 -- # set +x 00:05:00.878 [2024-04-26 14:52:41.649354] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:00.878 [2024-04-26 14:52:41.649400] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3314239 ] 00:05:00.878 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.878 [2024-04-26 14:52:41.713077] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:00.878 [2024-04-26 14:52:41.778251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:00.878 [2024-04-26 14:52:41.778256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.822 14:52:42 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:01.822 14:52:42 -- common/autotest_common.sh@860 -- # return 0 00:05:01.822 14:52:42 -- spdkcli/tcp.sh@31 -- # socat_pid=3314565 00:05:01.822 14:52:42 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:01.822 14:52:42 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:01.822 [ 00:05:01.822 "bdev_malloc_delete", 00:05:01.822 "bdev_malloc_create", 00:05:01.822 "bdev_null_resize", 00:05:01.822 "bdev_null_delete", 00:05:01.822 "bdev_null_create", 00:05:01.822 "bdev_nvme_cuse_unregister", 00:05:01.822 "bdev_nvme_cuse_register", 00:05:01.822 "bdev_opal_new_user", 00:05:01.822 "bdev_opal_set_lock_state", 00:05:01.822 "bdev_opal_delete", 00:05:01.822 "bdev_opal_get_info", 00:05:01.822 "bdev_opal_create", 00:05:01.822 "bdev_nvme_opal_revert", 00:05:01.822 "bdev_nvme_opal_init", 00:05:01.822 "bdev_nvme_send_cmd", 00:05:01.822 "bdev_nvme_get_path_iostat", 00:05:01.822 "bdev_nvme_get_mdns_discovery_info", 00:05:01.822 "bdev_nvme_stop_mdns_discovery", 00:05:01.822 "bdev_nvme_start_mdns_discovery", 00:05:01.822 "bdev_nvme_set_multipath_policy", 00:05:01.822 "bdev_nvme_set_preferred_path", 00:05:01.822 "bdev_nvme_get_io_paths", 00:05:01.822 "bdev_nvme_remove_error_injection", 00:05:01.822 "bdev_nvme_add_error_injection", 00:05:01.822 "bdev_nvme_get_discovery_info", 00:05:01.822 "bdev_nvme_stop_discovery", 00:05:01.822 "bdev_nvme_start_discovery", 00:05:01.822 "bdev_nvme_get_controller_health_info", 00:05:01.822 "bdev_nvme_disable_controller", 00:05:01.822 "bdev_nvme_enable_controller", 00:05:01.822 "bdev_nvme_reset_controller", 00:05:01.822 "bdev_nvme_get_transport_statistics", 00:05:01.822 "bdev_nvme_apply_firmware", 00:05:01.823 "bdev_nvme_detach_controller", 00:05:01.823 "bdev_nvme_get_controllers", 00:05:01.823 "bdev_nvme_attach_controller", 00:05:01.823 "bdev_nvme_set_hotplug", 00:05:01.823 "bdev_nvme_set_options", 00:05:01.823 "bdev_passthru_delete", 00:05:01.823 "bdev_passthru_create", 00:05:01.823 "bdev_lvol_grow_lvstore", 00:05:01.823 "bdev_lvol_get_lvols", 00:05:01.823 "bdev_lvol_get_lvstores", 00:05:01.823 "bdev_lvol_delete", 00:05:01.823 "bdev_lvol_set_read_only", 00:05:01.823 "bdev_lvol_resize", 00:05:01.823 "bdev_lvol_decouple_parent", 00:05:01.823 "bdev_lvol_inflate", 00:05:01.823 "bdev_lvol_rename", 00:05:01.823 "bdev_lvol_clone_bdev", 00:05:01.823 "bdev_lvol_clone", 00:05:01.823 "bdev_lvol_snapshot", 00:05:01.823 "bdev_lvol_create", 00:05:01.823 "bdev_lvol_delete_lvstore", 00:05:01.823 "bdev_lvol_rename_lvstore", 00:05:01.823 "bdev_lvol_create_lvstore", 00:05:01.823 "bdev_raid_set_options", 00:05:01.823 "bdev_raid_remove_base_bdev", 00:05:01.823 "bdev_raid_add_base_bdev", 00:05:01.823 "bdev_raid_delete", 00:05:01.823 "bdev_raid_create", 00:05:01.823 "bdev_raid_get_bdevs", 00:05:01.823 "bdev_error_inject_error", 00:05:01.823 "bdev_error_delete", 00:05:01.823 "bdev_error_create", 00:05:01.823 "bdev_split_delete", 00:05:01.823 "bdev_split_create", 00:05:01.823 "bdev_delay_delete", 00:05:01.823 "bdev_delay_create", 00:05:01.823 "bdev_delay_update_latency", 00:05:01.823 "bdev_zone_block_delete", 00:05:01.823 "bdev_zone_block_create", 00:05:01.823 "blobfs_create", 00:05:01.823 "blobfs_detect", 00:05:01.823 "blobfs_set_cache_size", 00:05:01.823 "bdev_aio_delete", 00:05:01.823 "bdev_aio_rescan", 00:05:01.823 "bdev_aio_create", 00:05:01.823 "bdev_ftl_set_property", 00:05:01.823 "bdev_ftl_get_properties", 00:05:01.823 "bdev_ftl_get_stats", 00:05:01.823 "bdev_ftl_unmap", 00:05:01.823 "bdev_ftl_unload", 00:05:01.823 "bdev_ftl_delete", 00:05:01.823 "bdev_ftl_load", 00:05:01.823 "bdev_ftl_create", 00:05:01.823 "bdev_virtio_attach_controller", 00:05:01.823 "bdev_virtio_scsi_get_devices", 00:05:01.823 "bdev_virtio_detach_controller", 00:05:01.823 "bdev_virtio_blk_set_hotplug", 00:05:01.823 "bdev_iscsi_delete", 00:05:01.823 "bdev_iscsi_create", 00:05:01.823 "bdev_iscsi_set_options", 00:05:01.823 "accel_error_inject_error", 00:05:01.823 "ioat_scan_accel_module", 00:05:01.823 "dsa_scan_accel_module", 00:05:01.823 "iaa_scan_accel_module", 00:05:01.823 "keyring_file_remove_key", 00:05:01.823 "keyring_file_add_key", 00:05:01.823 "iscsi_get_histogram", 00:05:01.823 "iscsi_enable_histogram", 00:05:01.823 "iscsi_set_options", 00:05:01.823 "iscsi_get_auth_groups", 00:05:01.823 "iscsi_auth_group_remove_secret", 00:05:01.823 "iscsi_auth_group_add_secret", 00:05:01.823 "iscsi_delete_auth_group", 00:05:01.823 "iscsi_create_auth_group", 00:05:01.823 "iscsi_set_discovery_auth", 00:05:01.823 "iscsi_get_options", 00:05:01.823 "iscsi_target_node_request_logout", 00:05:01.823 "iscsi_target_node_set_redirect", 00:05:01.823 "iscsi_target_node_set_auth", 00:05:01.823 "iscsi_target_node_add_lun", 00:05:01.823 "iscsi_get_stats", 00:05:01.823 "iscsi_get_connections", 00:05:01.823 "iscsi_portal_group_set_auth", 00:05:01.823 "iscsi_start_portal_group", 00:05:01.823 "iscsi_delete_portal_group", 00:05:01.823 "iscsi_create_portal_group", 00:05:01.823 "iscsi_get_portal_groups", 00:05:01.823 "iscsi_delete_target_node", 00:05:01.823 "iscsi_target_node_remove_pg_ig_maps", 00:05:01.823 "iscsi_target_node_add_pg_ig_maps", 00:05:01.823 "iscsi_create_target_node", 00:05:01.823 "iscsi_get_target_nodes", 00:05:01.823 "iscsi_delete_initiator_group", 00:05:01.823 "iscsi_initiator_group_remove_initiators", 00:05:01.823 "iscsi_initiator_group_add_initiators", 00:05:01.823 "iscsi_create_initiator_group", 00:05:01.823 "iscsi_get_initiator_groups", 00:05:01.823 "nvmf_set_crdt", 00:05:01.823 "nvmf_set_config", 00:05:01.823 "nvmf_set_max_subsystems", 00:05:01.823 "nvmf_subsystem_get_listeners", 00:05:01.823 "nvmf_subsystem_get_qpairs", 00:05:01.823 "nvmf_subsystem_get_controllers", 00:05:01.823 "nvmf_get_stats", 00:05:01.823 "nvmf_get_transports", 00:05:01.823 "nvmf_create_transport", 00:05:01.823 "nvmf_get_targets", 00:05:01.823 "nvmf_delete_target", 00:05:01.823 "nvmf_create_target", 00:05:01.823 "nvmf_subsystem_allow_any_host", 00:05:01.823 "nvmf_subsystem_remove_host", 00:05:01.823 "nvmf_subsystem_add_host", 00:05:01.823 "nvmf_ns_remove_host", 00:05:01.823 "nvmf_ns_add_host", 00:05:01.823 "nvmf_subsystem_remove_ns", 00:05:01.823 "nvmf_subsystem_add_ns", 00:05:01.823 "nvmf_subsystem_listener_set_ana_state", 00:05:01.823 "nvmf_discovery_get_referrals", 00:05:01.823 "nvmf_discovery_remove_referral", 00:05:01.823 "nvmf_discovery_add_referral", 00:05:01.823 "nvmf_subsystem_remove_listener", 00:05:01.823 "nvmf_subsystem_add_listener", 00:05:01.823 "nvmf_delete_subsystem", 00:05:01.823 "nvmf_create_subsystem", 00:05:01.823 "nvmf_get_subsystems", 00:05:01.823 "env_dpdk_get_mem_stats", 00:05:01.823 "nbd_get_disks", 00:05:01.823 "nbd_stop_disk", 00:05:01.823 "nbd_start_disk", 00:05:01.823 "ublk_recover_disk", 00:05:01.823 "ublk_get_disks", 00:05:01.823 "ublk_stop_disk", 00:05:01.823 "ublk_start_disk", 00:05:01.823 "ublk_destroy_target", 00:05:01.823 "ublk_create_target", 00:05:01.823 "virtio_blk_create_transport", 00:05:01.823 "virtio_blk_get_transports", 00:05:01.823 "vhost_controller_set_coalescing", 00:05:01.823 "vhost_get_controllers", 00:05:01.823 "vhost_delete_controller", 00:05:01.823 "vhost_create_blk_controller", 00:05:01.823 "vhost_scsi_controller_remove_target", 00:05:01.823 "vhost_scsi_controller_add_target", 00:05:01.823 "vhost_start_scsi_controller", 00:05:01.823 "vhost_create_scsi_controller", 00:05:01.823 "thread_set_cpumask", 00:05:01.823 "framework_get_scheduler", 00:05:01.823 "framework_set_scheduler", 00:05:01.823 "framework_get_reactors", 00:05:01.823 "thread_get_io_channels", 00:05:01.823 "thread_get_pollers", 00:05:01.823 "thread_get_stats", 00:05:01.823 "framework_monitor_context_switch", 00:05:01.823 "spdk_kill_instance", 00:05:01.823 "log_enable_timestamps", 00:05:01.823 "log_get_flags", 00:05:01.823 "log_clear_flag", 00:05:01.823 "log_set_flag", 00:05:01.823 "log_get_level", 00:05:01.823 "log_set_level", 00:05:01.823 "log_get_print_level", 00:05:01.823 "log_set_print_level", 00:05:01.823 "framework_enable_cpumask_locks", 00:05:01.823 "framework_disable_cpumask_locks", 00:05:01.823 "framework_wait_init", 00:05:01.823 "framework_start_init", 00:05:01.823 "scsi_get_devices", 00:05:01.823 "bdev_get_histogram", 00:05:01.823 "bdev_enable_histogram", 00:05:01.823 "bdev_set_qos_limit", 00:05:01.823 "bdev_set_qd_sampling_period", 00:05:01.823 "bdev_get_bdevs", 00:05:01.823 "bdev_reset_iostat", 00:05:01.823 "bdev_get_iostat", 00:05:01.823 "bdev_examine", 00:05:01.823 "bdev_wait_for_examine", 00:05:01.823 "bdev_set_options", 00:05:01.823 "notify_get_notifications", 00:05:01.823 "notify_get_types", 00:05:01.823 "accel_get_stats", 00:05:01.823 "accel_set_options", 00:05:01.823 "accel_set_driver", 00:05:01.823 "accel_crypto_key_destroy", 00:05:01.823 "accel_crypto_keys_get", 00:05:01.823 "accel_crypto_key_create", 00:05:01.823 "accel_assign_opc", 00:05:01.823 "accel_get_module_info", 00:05:01.823 "accel_get_opc_assignments", 00:05:01.823 "vmd_rescan", 00:05:01.823 "vmd_remove_device", 00:05:01.823 "vmd_enable", 00:05:01.823 "sock_get_default_impl", 00:05:01.823 "sock_set_default_impl", 00:05:01.823 "sock_impl_set_options", 00:05:01.823 "sock_impl_get_options", 00:05:01.823 "iobuf_get_stats", 00:05:01.823 "iobuf_set_options", 00:05:01.823 "framework_get_pci_devices", 00:05:01.823 "framework_get_config", 00:05:01.823 "framework_get_subsystems", 00:05:01.823 "trace_get_info", 00:05:01.823 "trace_get_tpoint_group_mask", 00:05:01.823 "trace_disable_tpoint_group", 00:05:01.823 "trace_enable_tpoint_group", 00:05:01.823 "trace_clear_tpoint_mask", 00:05:01.823 "trace_set_tpoint_mask", 00:05:01.823 "keyring_get_keys", 00:05:01.823 "spdk_get_version", 00:05:01.823 "rpc_get_methods" 00:05:01.823 ] 00:05:01.823 14:52:42 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:01.823 14:52:42 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:01.823 14:52:42 -- common/autotest_common.sh@10 -- # set +x 00:05:01.823 14:52:42 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:01.823 14:52:42 -- spdkcli/tcp.sh@38 -- # killprocess 3314239 00:05:01.823 14:52:42 -- common/autotest_common.sh@946 -- # '[' -z 3314239 ']' 00:05:01.823 14:52:42 -- common/autotest_common.sh@950 -- # kill -0 3314239 00:05:01.823 14:52:42 -- common/autotest_common.sh@951 -- # uname 00:05:01.823 14:52:42 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:01.823 14:52:42 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3314239 00:05:01.823 14:52:42 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:01.823 14:52:42 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:01.823 14:52:42 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3314239' 00:05:01.823 killing process with pid 3314239 00:05:01.823 14:52:42 -- common/autotest_common.sh@965 -- # kill 3314239 00:05:01.823 14:52:42 -- common/autotest_common.sh@970 -- # wait 3314239 00:05:02.084 00:05:02.084 real 0m1.372s 00:05:02.084 user 0m2.493s 00:05:02.084 sys 0m0.411s 00:05:02.084 14:52:42 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:02.084 14:52:42 -- common/autotest_common.sh@10 -- # set +x 00:05:02.084 ************************************ 00:05:02.084 END TEST spdkcli_tcp 00:05:02.084 ************************************ 00:05:02.084 14:52:42 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:02.084 14:52:42 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:02.084 14:52:42 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:02.084 14:52:42 -- common/autotest_common.sh@10 -- # set +x 00:05:02.346 ************************************ 00:05:02.346 START TEST dpdk_mem_utility 00:05:02.346 ************************************ 00:05:02.346 14:52:43 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:02.346 * Looking for test storage... 00:05:02.346 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:05:02.346 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:02.346 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3314650 00:05:02.346 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3314650 00:05:02.346 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:02.346 14:52:43 -- common/autotest_common.sh@827 -- # '[' -z 3314650 ']' 00:05:02.346 14:52:43 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.346 14:52:43 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:02.346 14:52:43 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.346 14:52:43 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:02.346 14:52:43 -- common/autotest_common.sh@10 -- # set +x 00:05:02.346 [2024-04-26 14:52:43.200576] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:02.346 [2024-04-26 14:52:43.200640] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3314650 ] 00:05:02.346 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.346 [2024-04-26 14:52:43.264196] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.606 [2024-04-26 14:52:43.336732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.176 14:52:43 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:03.176 14:52:43 -- common/autotest_common.sh@860 -- # return 0 00:05:03.176 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:03.176 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:03.176 14:52:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:03.176 14:52:43 -- common/autotest_common.sh@10 -- # set +x 00:05:03.176 { 00:05:03.176 "filename": "/tmp/spdk_mem_dump.txt" 00:05:03.176 } 00:05:03.176 14:52:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:03.176 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:03.176 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:03.176 1 heaps totaling size 814.000000 MiB 00:05:03.176 size: 814.000000 MiB heap id: 0 00:05:03.176 end heaps---------- 00:05:03.176 8 mempools totaling size 598.116089 MiB 00:05:03.176 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:03.176 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:03.176 size: 84.521057 MiB name: bdev_io_3314650 00:05:03.176 size: 51.011292 MiB name: evtpool_3314650 00:05:03.176 size: 50.003479 MiB name: msgpool_3314650 00:05:03.176 size: 21.763794 MiB name: PDU_Pool 00:05:03.176 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:03.176 size: 0.026123 MiB name: Session_Pool 00:05:03.176 end mempools------- 00:05:03.176 6 memzones totaling size 4.142822 MiB 00:05:03.176 size: 1.000366 MiB name: RG_ring_0_3314650 00:05:03.176 size: 1.000366 MiB name: RG_ring_1_3314650 00:05:03.176 size: 1.000366 MiB name: RG_ring_4_3314650 00:05:03.176 size: 1.000366 MiB name: RG_ring_5_3314650 00:05:03.176 size: 0.125366 MiB name: RG_ring_2_3314650 00:05:03.176 size: 0.015991 MiB name: RG_ring_3_3314650 00:05:03.176 end memzones------- 00:05:03.176 14:52:43 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:03.176 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:03.176 list of free elements. size: 12.519348 MiB 00:05:03.176 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:03.176 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:03.176 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:03.176 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:03.176 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:03.176 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:03.176 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:03.176 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:03.176 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:03.176 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:03.176 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:03.176 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:03.176 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:03.176 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:03.176 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:03.176 list of standard malloc elements. size: 199.218079 MiB 00:05:03.176 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:03.176 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:03.176 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:03.176 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:03.176 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:03.176 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:03.176 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:03.176 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:03.176 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:03.176 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:03.176 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:03.176 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:03.176 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:03.176 list of memzone associated elements. size: 602.262573 MiB 00:05:03.176 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:03.176 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:03.176 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:03.176 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:03.176 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:03.176 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3314650_0 00:05:03.176 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:03.176 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3314650_0 00:05:03.176 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:03.176 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3314650_0 00:05:03.176 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:03.177 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:03.177 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:03.177 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:03.177 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:03.177 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3314650 00:05:03.177 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:03.177 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3314650 00:05:03.177 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:03.177 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3314650 00:05:03.177 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:03.177 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:03.177 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:03.177 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:03.177 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:03.177 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:03.177 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:03.177 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:03.177 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:03.177 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3314650 00:05:03.177 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:03.177 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3314650 00:05:03.177 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:03.177 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3314650 00:05:03.177 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:03.177 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3314650 00:05:03.177 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:03.177 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3314650 00:05:03.177 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:03.177 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:03.177 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:03.177 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:03.177 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:03.177 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:03.177 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:03.177 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3314650 00:05:03.177 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:03.177 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:03.177 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:03.177 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:03.177 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:03.177 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3314650 00:05:03.177 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:03.177 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:03.177 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:03.177 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3314650 00:05:03.177 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:03.177 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3314650 00:05:03.177 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:03.177 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:03.177 14:52:44 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:03.177 14:52:44 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3314650 00:05:03.177 14:52:44 -- common/autotest_common.sh@946 -- # '[' -z 3314650 ']' 00:05:03.177 14:52:44 -- common/autotest_common.sh@950 -- # kill -0 3314650 00:05:03.177 14:52:44 -- common/autotest_common.sh@951 -- # uname 00:05:03.177 14:52:44 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:03.177 14:52:44 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3314650 00:05:03.177 14:52:44 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:03.177 14:52:44 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:03.177 14:52:44 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3314650' 00:05:03.177 killing process with pid 3314650 00:05:03.177 14:52:44 -- common/autotest_common.sh@965 -- # kill 3314650 00:05:03.177 14:52:44 -- common/autotest_common.sh@970 -- # wait 3314650 00:05:03.438 00:05:03.438 real 0m1.275s 00:05:03.438 user 0m1.344s 00:05:03.438 sys 0m0.372s 00:05:03.438 14:52:44 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:03.438 14:52:44 -- common/autotest_common.sh@10 -- # set +x 00:05:03.438 ************************************ 00:05:03.438 END TEST dpdk_mem_utility 00:05:03.438 ************************************ 00:05:03.438 14:52:44 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:03.438 14:52:44 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:03.438 14:52:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:03.438 14:52:44 -- common/autotest_common.sh@10 -- # set +x 00:05:03.699 ************************************ 00:05:03.699 START TEST event 00:05:03.699 ************************************ 00:05:03.699 14:52:44 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:03.699 * Looking for test storage... 00:05:03.699 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:03.699 14:52:44 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:03.699 14:52:44 -- bdev/nbd_common.sh@6 -- # set -e 00:05:03.699 14:52:44 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:03.699 14:52:44 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:05:03.699 14:52:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:03.699 14:52:44 -- common/autotest_common.sh@10 -- # set +x 00:05:03.960 ************************************ 00:05:03.960 START TEST event_perf 00:05:03.960 ************************************ 00:05:03.960 14:52:44 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:03.960 Running I/O for 1 seconds...[2024-04-26 14:52:44.753634] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:03.960 [2024-04-26 14:52:44.753732] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3315057 ] 00:05:03.960 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.960 [2024-04-26 14:52:44.817647] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:03.960 [2024-04-26 14:52:44.882661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:03.960 [2024-04-26 14:52:44.882793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:03.960 [2024-04-26 14:52:44.882927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:03.960 [2024-04-26 14:52:44.882930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:05.348 Running I/O for 1 seconds... 00:05:05.348 lcore 0: 170706 00:05:05.348 lcore 1: 170706 00:05:05.348 lcore 2: 170708 00:05:05.348 lcore 3: 170711 00:05:05.348 done. 00:05:05.348 00:05:05.348 real 0m1.204s 00:05:05.348 user 0m4.126s 00:05:05.348 sys 0m0.075s 00:05:05.348 14:52:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:05.348 14:52:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.348 ************************************ 00:05:05.348 END TEST event_perf 00:05:05.348 ************************************ 00:05:05.348 14:52:45 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:05.348 14:52:45 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:05:05.348 14:52:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:05.348 14:52:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.348 ************************************ 00:05:05.348 START TEST event_reactor 00:05:05.348 ************************************ 00:05:05.348 14:52:46 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:05.348 [2024-04-26 14:52:46.143113] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:05.348 [2024-04-26 14:52:46.143214] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3315421 ] 00:05:05.348 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.348 [2024-04-26 14:52:46.220087] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.348 [2024-04-26 14:52:46.290506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.733 test_start 00:05:06.733 oneshot 00:05:06.733 tick 100 00:05:06.733 tick 100 00:05:06.733 tick 250 00:05:06.733 tick 100 00:05:06.733 tick 100 00:05:06.733 tick 250 00:05:06.733 tick 100 00:05:06.733 tick 500 00:05:06.733 tick 100 00:05:06.733 tick 100 00:05:06.733 tick 250 00:05:06.733 tick 100 00:05:06.733 tick 100 00:05:06.733 test_end 00:05:06.733 00:05:06.733 real 0m1.222s 00:05:06.733 user 0m1.134s 00:05:06.733 sys 0m0.084s 00:05:06.733 14:52:47 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:06.733 14:52:47 -- common/autotest_common.sh@10 -- # set +x 00:05:06.733 ************************************ 00:05:06.733 END TEST event_reactor 00:05:06.733 ************************************ 00:05:06.733 14:52:47 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:06.733 14:52:47 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:05:06.733 14:52:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:06.733 14:52:47 -- common/autotest_common.sh@10 -- # set +x 00:05:06.733 ************************************ 00:05:06.733 START TEST event_reactor_perf 00:05:06.733 ************************************ 00:05:06.734 14:52:47 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:06.734 [2024-04-26 14:52:47.548575] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:06.734 [2024-04-26 14:52:47.548694] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3315781 ] 00:05:06.734 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.734 [2024-04-26 14:52:47.618158] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.994 [2024-04-26 14:52:47.685491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.936 test_start 00:05:07.937 test_end 00:05:07.937 Performance: 367917 events per second 00:05:07.937 00:05:07.937 real 0m1.212s 00:05:07.937 user 0m1.133s 00:05:07.937 sys 0m0.075s 00:05:07.937 14:52:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:07.937 14:52:48 -- common/autotest_common.sh@10 -- # set +x 00:05:07.937 ************************************ 00:05:07.937 END TEST event_reactor_perf 00:05:07.937 ************************************ 00:05:07.937 14:52:48 -- event/event.sh@49 -- # uname -s 00:05:07.937 14:52:48 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:07.937 14:52:48 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:07.937 14:52:48 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:07.937 14:52:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:07.937 14:52:48 -- common/autotest_common.sh@10 -- # set +x 00:05:08.198 ************************************ 00:05:08.198 START TEST event_scheduler 00:05:08.198 ************************************ 00:05:08.198 14:52:48 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:08.198 * Looking for test storage... 00:05:08.198 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:05:08.198 14:52:49 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:08.198 14:52:49 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3316150 00:05:08.198 14:52:49 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:08.198 14:52:49 -- scheduler/scheduler.sh@37 -- # waitforlisten 3316150 00:05:08.198 14:52:49 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:08.198 14:52:49 -- common/autotest_common.sh@827 -- # '[' -z 3316150 ']' 00:05:08.198 14:52:49 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.198 14:52:49 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:08.198 14:52:49 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.198 14:52:49 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:08.198 14:52:49 -- common/autotest_common.sh@10 -- # set +x 00:05:08.198 [2024-04-26 14:52:49.079234] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:08.198 [2024-04-26 14:52:49.079305] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3316150 ] 00:05:08.198 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.198 [2024-04-26 14:52:49.135444] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:08.459 [2024-04-26 14:52:49.199860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.459 [2024-04-26 14:52:49.199998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:08.459 [2024-04-26 14:52:49.200123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:08.459 [2024-04-26 14:52:49.200125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:09.028 14:52:49 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:09.029 14:52:49 -- common/autotest_common.sh@860 -- # return 0 00:05:09.029 14:52:49 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:09.029 14:52:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.029 14:52:49 -- common/autotest_common.sh@10 -- # set +x 00:05:09.029 POWER: Env isn't set yet! 00:05:09.029 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:09.029 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:09.029 POWER: Cannot set governor of lcore 0 to userspace 00:05:09.029 POWER: Attempting to initialise PSTAT power management... 00:05:09.029 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:09.029 POWER: Initialized successfully for lcore 0 power management 00:05:09.029 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:09.029 POWER: Initialized successfully for lcore 1 power management 00:05:09.029 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:09.029 POWER: Initialized successfully for lcore 2 power management 00:05:09.029 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:09.029 POWER: Initialized successfully for lcore 3 power management 00:05:09.029 14:52:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.029 14:52:49 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:09.029 14:52:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.029 14:52:49 -- common/autotest_common.sh@10 -- # set +x 00:05:09.029 [2024-04-26 14:52:49.971932] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:09.029 14:52:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.029 14:52:49 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:09.029 14:52:49 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:09.029 14:52:49 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:09.029 14:52:49 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 ************************************ 00:05:09.290 START TEST scheduler_create_thread 00:05:09.290 ************************************ 00:05:09.290 14:52:50 -- common/autotest_common.sh@1121 -- # scheduler_create_thread 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 2 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 3 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 4 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 5 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 6 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 7 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.290 8 00:05:09.290 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.290 14:52:50 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:09.290 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.290 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:09.880 9 00:05:09.880 14:52:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:09.880 14:52:50 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:09.880 14:52:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:09.880 14:52:50 -- common/autotest_common.sh@10 -- # set +x 00:05:11.266 10 00:05:11.266 14:52:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:11.266 14:52:51 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:11.266 14:52:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:11.266 14:52:51 -- common/autotest_common.sh@10 -- # set +x 00:05:12.209 14:52:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:12.209 14:52:53 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:12.209 14:52:53 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:12.209 14:52:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:12.209 14:52:53 -- common/autotest_common.sh@10 -- # set +x 00:05:13.149 14:52:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:13.149 14:52:54 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:13.149 14:52:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:13.149 14:52:54 -- common/autotest_common.sh@10 -- # set +x 00:05:14.088 14:52:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:14.088 14:52:54 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:14.088 14:52:54 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:14.088 14:52:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:14.088 14:52:54 -- common/autotest_common.sh@10 -- # set +x 00:05:14.660 14:52:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:14.660 00:05:14.660 real 0m5.399s 00:05:14.660 user 0m0.027s 00:05:14.660 sys 0m0.004s 00:05:14.660 14:52:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:14.660 14:52:55 -- common/autotest_common.sh@10 -- # set +x 00:05:14.660 ************************************ 00:05:14.660 END TEST scheduler_create_thread 00:05:14.660 ************************************ 00:05:14.660 14:52:55 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:14.660 14:52:55 -- scheduler/scheduler.sh@46 -- # killprocess 3316150 00:05:14.660 14:52:55 -- common/autotest_common.sh@946 -- # '[' -z 3316150 ']' 00:05:14.660 14:52:55 -- common/autotest_common.sh@950 -- # kill -0 3316150 00:05:14.660 14:52:55 -- common/autotest_common.sh@951 -- # uname 00:05:14.660 14:52:55 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:14.660 14:52:55 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3316150 00:05:14.921 14:52:55 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:05:14.921 14:52:55 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:05:14.921 14:52:55 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3316150' 00:05:14.921 killing process with pid 3316150 00:05:14.921 14:52:55 -- common/autotest_common.sh@965 -- # kill 3316150 00:05:14.921 14:52:55 -- common/autotest_common.sh@970 -- # wait 3316150 00:05:14.921 [2024-04-26 14:52:55.807600] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:15.182 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:15.182 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:15.182 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:15.182 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:15.182 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:15.182 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:15.182 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:15.182 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:15.182 00:05:15.182 real 0m7.058s 00:05:15.182 user 0m14.258s 00:05:15.182 sys 0m0.448s 00:05:15.182 14:52:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:15.182 14:52:55 -- common/autotest_common.sh@10 -- # set +x 00:05:15.182 ************************************ 00:05:15.182 END TEST event_scheduler 00:05:15.182 ************************************ 00:05:15.182 14:52:56 -- event/event.sh@51 -- # modprobe -n nbd 00:05:15.182 14:52:56 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:15.182 14:52:56 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:15.182 14:52:56 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:15.182 14:52:56 -- common/autotest_common.sh@10 -- # set +x 00:05:15.443 ************************************ 00:05:15.443 START TEST app_repeat 00:05:15.443 ************************************ 00:05:15.443 14:52:56 -- common/autotest_common.sh@1121 -- # app_repeat_test 00:05:15.443 14:52:56 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.443 14:52:56 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.443 14:52:56 -- event/event.sh@13 -- # local nbd_list 00:05:15.443 14:52:56 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:15.443 14:52:56 -- event/event.sh@14 -- # local bdev_list 00:05:15.443 14:52:56 -- event/event.sh@15 -- # local repeat_times=4 00:05:15.443 14:52:56 -- event/event.sh@17 -- # modprobe nbd 00:05:15.443 14:52:56 -- event/event.sh@19 -- # repeat_pid=3317575 00:05:15.443 14:52:56 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:15.443 14:52:56 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:15.443 14:52:56 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3317575' 00:05:15.443 Process app_repeat pid: 3317575 00:05:15.443 14:52:56 -- event/event.sh@23 -- # for i in {0..2} 00:05:15.443 14:52:56 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:15.443 spdk_app_start Round 0 00:05:15.443 14:52:56 -- event/event.sh@25 -- # waitforlisten 3317575 /var/tmp/spdk-nbd.sock 00:05:15.443 14:52:56 -- common/autotest_common.sh@827 -- # '[' -z 3317575 ']' 00:05:15.443 14:52:56 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:15.443 14:52:56 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:15.443 14:52:56 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:15.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:15.443 14:52:56 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:15.443 14:52:56 -- common/autotest_common.sh@10 -- # set +x 00:05:15.443 [2024-04-26 14:52:56.207633] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:15.443 [2024-04-26 14:52:56.207700] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3317575 ] 00:05:15.443 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.443 [2024-04-26 14:52:56.269785] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:15.443 [2024-04-26 14:52:56.338095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:15.443 [2024-04-26 14:52:56.338100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.385 14:52:57 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:16.385 14:52:57 -- common/autotest_common.sh@860 -- # return 0 00:05:16.385 14:52:57 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:16.385 Malloc0 00:05:16.385 14:52:57 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:16.385 Malloc1 00:05:16.385 14:52:57 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@12 -- # local i 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.385 14:52:57 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:16.645 /dev/nbd0 00:05:16.645 14:52:57 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:16.645 14:52:57 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:16.645 14:52:57 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:05:16.645 14:52:57 -- common/autotest_common.sh@865 -- # local i 00:05:16.645 14:52:57 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:16.645 14:52:57 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:16.645 14:52:57 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:05:16.645 14:52:57 -- common/autotest_common.sh@869 -- # break 00:05:16.645 14:52:57 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:16.645 14:52:57 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:16.645 14:52:57 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:16.645 1+0 records in 00:05:16.645 1+0 records out 00:05:16.645 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000293164 s, 14.0 MB/s 00:05:16.645 14:52:57 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.645 14:52:57 -- common/autotest_common.sh@882 -- # size=4096 00:05:16.645 14:52:57 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.645 14:52:57 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:16.645 14:52:57 -- common/autotest_common.sh@885 -- # return 0 00:05:16.645 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:16.645 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.645 14:52:57 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:16.905 /dev/nbd1 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:16.905 14:52:57 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:05:16.905 14:52:57 -- common/autotest_common.sh@865 -- # local i 00:05:16.905 14:52:57 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:16.905 14:52:57 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:16.905 14:52:57 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:05:16.905 14:52:57 -- common/autotest_common.sh@869 -- # break 00:05:16.905 14:52:57 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:16.905 14:52:57 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:16.905 14:52:57 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:16.905 1+0 records in 00:05:16.905 1+0 records out 00:05:16.905 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000250702 s, 16.3 MB/s 00:05:16.905 14:52:57 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.905 14:52:57 -- common/autotest_common.sh@882 -- # size=4096 00:05:16.905 14:52:57 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.905 14:52:57 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:16.905 14:52:57 -- common/autotest_common.sh@885 -- # return 0 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.905 14:52:57 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:17.167 { 00:05:17.167 "nbd_device": "/dev/nbd0", 00:05:17.167 "bdev_name": "Malloc0" 00:05:17.167 }, 00:05:17.167 { 00:05:17.167 "nbd_device": "/dev/nbd1", 00:05:17.167 "bdev_name": "Malloc1" 00:05:17.167 } 00:05:17.167 ]' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:17.167 { 00:05:17.167 "nbd_device": "/dev/nbd0", 00:05:17.167 "bdev_name": "Malloc0" 00:05:17.167 }, 00:05:17.167 { 00:05:17.167 "nbd_device": "/dev/nbd1", 00:05:17.167 "bdev_name": "Malloc1" 00:05:17.167 } 00:05:17.167 ]' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:17.167 /dev/nbd1' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:17.167 /dev/nbd1' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@65 -- # count=2 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@95 -- # count=2 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:17.167 256+0 records in 00:05:17.167 256+0 records out 00:05:17.167 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124715 s, 84.1 MB/s 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:17.167 256+0 records in 00:05:17.167 256+0 records out 00:05:17.167 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161431 s, 65.0 MB/s 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:17.167 256+0 records in 00:05:17.167 256+0 records out 00:05:17.167 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196424 s, 53.4 MB/s 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:17.167 14:52:57 -- bdev/nbd_common.sh@51 -- # local i 00:05:17.168 14:52:57 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:17.168 14:52:57 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@41 -- # break 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@45 -- # return 0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@41 -- # break 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@45 -- # return 0 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:17.429 14:52:58 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@65 -- # true 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@65 -- # count=0 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@104 -- # count=0 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:17.691 14:52:58 -- bdev/nbd_common.sh@109 -- # return 0 00:05:17.691 14:52:58 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:17.952 14:52:58 -- event/event.sh@35 -- # sleep 3 00:05:17.952 [2024-04-26 14:52:58.815805] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:17.952 [2024-04-26 14:52:58.876362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:17.952 [2024-04-26 14:52:58.876507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.213 [2024-04-26 14:52:58.908523] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:18.213 [2024-04-26 14:52:58.908558] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:20.759 14:53:01 -- event/event.sh@23 -- # for i in {0..2} 00:05:20.759 14:53:01 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:20.759 spdk_app_start Round 1 00:05:20.759 14:53:01 -- event/event.sh@25 -- # waitforlisten 3317575 /var/tmp/spdk-nbd.sock 00:05:20.759 14:53:01 -- common/autotest_common.sh@827 -- # '[' -z 3317575 ']' 00:05:20.759 14:53:01 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:20.759 14:53:01 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:20.759 14:53:01 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:20.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:20.759 14:53:01 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:20.759 14:53:01 -- common/autotest_common.sh@10 -- # set +x 00:05:21.020 14:53:01 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:21.020 14:53:01 -- common/autotest_common.sh@860 -- # return 0 00:05:21.020 14:53:01 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:21.281 Malloc0 00:05:21.281 14:53:01 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:21.281 Malloc1 00:05:21.281 14:53:02 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@12 -- # local i 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.281 14:53:02 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:21.542 /dev/nbd0 00:05:21.542 14:53:02 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:21.543 14:53:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:21.543 14:53:02 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:05:21.543 14:53:02 -- common/autotest_common.sh@865 -- # local i 00:05:21.543 14:53:02 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:21.543 14:53:02 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:21.543 14:53:02 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:05:21.543 14:53:02 -- common/autotest_common.sh@869 -- # break 00:05:21.543 14:53:02 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:21.543 14:53:02 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:21.543 14:53:02 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:21.543 1+0 records in 00:05:21.543 1+0 records out 00:05:21.543 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000246027 s, 16.6 MB/s 00:05:21.543 14:53:02 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.543 14:53:02 -- common/autotest_common.sh@882 -- # size=4096 00:05:21.543 14:53:02 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.543 14:53:02 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:21.543 14:53:02 -- common/autotest_common.sh@885 -- # return 0 00:05:21.543 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:21.543 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.543 14:53:02 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:21.543 /dev/nbd1 00:05:21.543 14:53:02 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:21.804 14:53:02 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:05:21.804 14:53:02 -- common/autotest_common.sh@865 -- # local i 00:05:21.804 14:53:02 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:21.804 14:53:02 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:21.804 14:53:02 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:05:21.804 14:53:02 -- common/autotest_common.sh@869 -- # break 00:05:21.804 14:53:02 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:21.804 14:53:02 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:21.804 14:53:02 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:21.804 1+0 records in 00:05:21.804 1+0 records out 00:05:21.804 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000244483 s, 16.8 MB/s 00:05:21.804 14:53:02 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.804 14:53:02 -- common/autotest_common.sh@882 -- # size=4096 00:05:21.804 14:53:02 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.804 14:53:02 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:21.804 14:53:02 -- common/autotest_common.sh@885 -- # return 0 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:21.804 { 00:05:21.804 "nbd_device": "/dev/nbd0", 00:05:21.804 "bdev_name": "Malloc0" 00:05:21.804 }, 00:05:21.804 { 00:05:21.804 "nbd_device": "/dev/nbd1", 00:05:21.804 "bdev_name": "Malloc1" 00:05:21.804 } 00:05:21.804 ]' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:21.804 { 00:05:21.804 "nbd_device": "/dev/nbd0", 00:05:21.804 "bdev_name": "Malloc0" 00:05:21.804 }, 00:05:21.804 { 00:05:21.804 "nbd_device": "/dev/nbd1", 00:05:21.804 "bdev_name": "Malloc1" 00:05:21.804 } 00:05:21.804 ]' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:21.804 /dev/nbd1' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:21.804 /dev/nbd1' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@65 -- # count=2 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@95 -- # count=2 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:21.804 256+0 records in 00:05:21.804 256+0 records out 00:05:21.804 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121831 s, 86.1 MB/s 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:21.804 14:53:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:22.065 256+0 records in 00:05:22.065 256+0 records out 00:05:22.065 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165406 s, 63.4 MB/s 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:22.065 256+0 records in 00:05:22.065 256+0 records out 00:05:22.065 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179825 s, 58.3 MB/s 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@51 -- # local i 00:05:22.065 14:53:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@41 -- # break 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@45 -- # return 0 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:22.066 14:53:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@41 -- # break 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@45 -- # return 0 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:22.327 14:53:03 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@65 -- # true 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@65 -- # count=0 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@104 -- # count=0 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:22.588 14:53:03 -- bdev/nbd_common.sh@109 -- # return 0 00:05:22.588 14:53:03 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:22.588 14:53:03 -- event/event.sh@35 -- # sleep 3 00:05:22.850 [2024-04-26 14:53:03.630504] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:22.850 [2024-04-26 14:53:03.691838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:22.850 [2024-04-26 14:53:03.691843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.850 [2024-04-26 14:53:03.724645] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:22.850 [2024-04-26 14:53:03.724679] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:26.159 14:53:06 -- event/event.sh@23 -- # for i in {0..2} 00:05:26.159 14:53:06 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:26.159 spdk_app_start Round 2 00:05:26.159 14:53:06 -- event/event.sh@25 -- # waitforlisten 3317575 /var/tmp/spdk-nbd.sock 00:05:26.159 14:53:06 -- common/autotest_common.sh@827 -- # '[' -z 3317575 ']' 00:05:26.159 14:53:06 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:26.159 14:53:06 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:26.159 14:53:06 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:26.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:26.159 14:53:06 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:26.159 14:53:06 -- common/autotest_common.sh@10 -- # set +x 00:05:26.159 14:53:06 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:26.159 14:53:06 -- common/autotest_common.sh@860 -- # return 0 00:05:26.159 14:53:06 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:26.159 Malloc0 00:05:26.159 14:53:06 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:26.159 Malloc1 00:05:26.159 14:53:06 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@12 -- # local i 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:26.159 14:53:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:26.159 /dev/nbd0 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:26.420 14:53:07 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:05:26.420 14:53:07 -- common/autotest_common.sh@865 -- # local i 00:05:26.420 14:53:07 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:05:26.420 14:53:07 -- common/autotest_common.sh@869 -- # break 00:05:26.420 14:53:07 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:26.420 1+0 records in 00:05:26.420 1+0 records out 00:05:26.420 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000283124 s, 14.5 MB/s 00:05:26.420 14:53:07 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:26.420 14:53:07 -- common/autotest_common.sh@882 -- # size=4096 00:05:26.420 14:53:07 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:26.420 14:53:07 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:26.420 14:53:07 -- common/autotest_common.sh@885 -- # return 0 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:26.420 /dev/nbd1 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:26.420 14:53:07 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:05:26.420 14:53:07 -- common/autotest_common.sh@865 -- # local i 00:05:26.420 14:53:07 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:05:26.420 14:53:07 -- common/autotest_common.sh@869 -- # break 00:05:26.420 14:53:07 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:26.420 14:53:07 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:26.420 1+0 records in 00:05:26.420 1+0 records out 00:05:26.420 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000248018 s, 16.5 MB/s 00:05:26.420 14:53:07 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:26.420 14:53:07 -- common/autotest_common.sh@882 -- # size=4096 00:05:26.420 14:53:07 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:26.420 14:53:07 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:26.420 14:53:07 -- common/autotest_common.sh@885 -- # return 0 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:26.420 14:53:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:26.682 { 00:05:26.682 "nbd_device": "/dev/nbd0", 00:05:26.682 "bdev_name": "Malloc0" 00:05:26.682 }, 00:05:26.682 { 00:05:26.682 "nbd_device": "/dev/nbd1", 00:05:26.682 "bdev_name": "Malloc1" 00:05:26.682 } 00:05:26.682 ]' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:26.682 { 00:05:26.682 "nbd_device": "/dev/nbd0", 00:05:26.682 "bdev_name": "Malloc0" 00:05:26.682 }, 00:05:26.682 { 00:05:26.682 "nbd_device": "/dev/nbd1", 00:05:26.682 "bdev_name": "Malloc1" 00:05:26.682 } 00:05:26.682 ]' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:26.682 /dev/nbd1' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:26.682 /dev/nbd1' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@65 -- # count=2 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@95 -- # count=2 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:26.682 256+0 records in 00:05:26.682 256+0 records out 00:05:26.682 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122058 s, 85.9 MB/s 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:26.682 256+0 records in 00:05:26.682 256+0 records out 00:05:26.682 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152549 s, 68.7 MB/s 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:26.682 256+0 records in 00:05:26.682 256+0 records out 00:05:26.682 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184474 s, 56.8 MB/s 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@51 -- # local i 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:26.682 14:53:07 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@41 -- # break 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@45 -- # return 0 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:26.944 14:53:07 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@41 -- # break 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@45 -- # return 0 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:27.204 14:53:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:27.204 14:53:08 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:27.204 14:53:08 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:27.204 14:53:08 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@65 -- # true 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@65 -- # count=0 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@104 -- # count=0 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:27.465 14:53:08 -- bdev/nbd_common.sh@109 -- # return 0 00:05:27.465 14:53:08 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:27.465 14:53:08 -- event/event.sh@35 -- # sleep 3 00:05:27.734 [2024-04-26 14:53:08.438958] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:27.734 [2024-04-26 14:53:08.499313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:27.734 [2024-04-26 14:53:08.499319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.734 [2024-04-26 14:53:08.531234] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:27.734 [2024-04-26 14:53:08.531272] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:31.090 14:53:11 -- event/event.sh@38 -- # waitforlisten 3317575 /var/tmp/spdk-nbd.sock 00:05:31.090 14:53:11 -- common/autotest_common.sh@827 -- # '[' -z 3317575 ']' 00:05:31.090 14:53:11 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:31.090 14:53:11 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:31.090 14:53:11 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:31.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:31.090 14:53:11 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:31.090 14:53:11 -- common/autotest_common.sh@10 -- # set +x 00:05:31.090 14:53:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:31.090 14:53:11 -- common/autotest_common.sh@860 -- # return 0 00:05:31.090 14:53:11 -- event/event.sh@39 -- # killprocess 3317575 00:05:31.090 14:53:11 -- common/autotest_common.sh@946 -- # '[' -z 3317575 ']' 00:05:31.090 14:53:11 -- common/autotest_common.sh@950 -- # kill -0 3317575 00:05:31.090 14:53:11 -- common/autotest_common.sh@951 -- # uname 00:05:31.090 14:53:11 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:31.090 14:53:11 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3317575 00:05:31.090 14:53:11 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:31.090 14:53:11 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:31.090 14:53:11 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3317575' 00:05:31.090 killing process with pid 3317575 00:05:31.090 14:53:11 -- common/autotest_common.sh@965 -- # kill 3317575 00:05:31.090 14:53:11 -- common/autotest_common.sh@970 -- # wait 3317575 00:05:31.090 spdk_app_start is called in Round 0. 00:05:31.090 Shutdown signal received, stop current app iteration 00:05:31.090 Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 reinitialization... 00:05:31.090 spdk_app_start is called in Round 1. 00:05:31.090 Shutdown signal received, stop current app iteration 00:05:31.090 Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 reinitialization... 00:05:31.090 spdk_app_start is called in Round 2. 00:05:31.090 Shutdown signal received, stop current app iteration 00:05:31.090 Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 reinitialization... 00:05:31.090 spdk_app_start is called in Round 3. 00:05:31.090 Shutdown signal received, stop current app iteration 00:05:31.090 14:53:11 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:31.090 14:53:11 -- event/event.sh@42 -- # return 0 00:05:31.090 00:05:31.090 real 0m15.457s 00:05:31.090 user 0m33.424s 00:05:31.090 sys 0m2.066s 00:05:31.090 14:53:11 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:31.091 14:53:11 -- common/autotest_common.sh@10 -- # set +x 00:05:31.091 ************************************ 00:05:31.091 END TEST app_repeat 00:05:31.091 ************************************ 00:05:31.091 14:53:11 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:31.091 14:53:11 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:31.091 14:53:11 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:31.091 14:53:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:31.091 14:53:11 -- common/autotest_common.sh@10 -- # set +x 00:05:31.091 ************************************ 00:05:31.091 START TEST cpu_locks 00:05:31.091 ************************************ 00:05:31.091 14:53:11 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:31.091 * Looking for test storage... 00:05:31.091 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:31.091 14:53:11 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:31.091 14:53:11 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:31.091 14:53:11 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:31.091 14:53:11 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:31.091 14:53:11 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:31.091 14:53:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:31.091 14:53:11 -- common/autotest_common.sh@10 -- # set +x 00:05:31.091 ************************************ 00:05:31.091 START TEST default_locks 00:05:31.091 ************************************ 00:05:31.091 14:53:11 -- common/autotest_common.sh@1121 -- # default_locks 00:05:31.091 14:53:11 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3320856 00:05:31.091 14:53:11 -- event/cpu_locks.sh@47 -- # waitforlisten 3320856 00:05:31.091 14:53:11 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:31.091 14:53:11 -- common/autotest_common.sh@827 -- # '[' -z 3320856 ']' 00:05:31.091 14:53:12 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:31.091 14:53:12 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:31.091 14:53:12 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:31.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:31.091 14:53:12 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:31.091 14:53:12 -- common/autotest_common.sh@10 -- # set +x 00:05:31.354 [2024-04-26 14:53:12.050811] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:31.354 [2024-04-26 14:53:12.050863] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320856 ] 00:05:31.354 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.354 [2024-04-26 14:53:12.110687] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.354 [2024-04-26 14:53:12.174193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.925 14:53:12 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:31.925 14:53:12 -- common/autotest_common.sh@860 -- # return 0 00:05:31.925 14:53:12 -- event/cpu_locks.sh@49 -- # locks_exist 3320856 00:05:31.925 14:53:12 -- event/cpu_locks.sh@22 -- # lslocks -p 3320856 00:05:31.925 14:53:12 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:32.503 lslocks: write error 00:05:32.503 14:53:13 -- event/cpu_locks.sh@50 -- # killprocess 3320856 00:05:32.503 14:53:13 -- common/autotest_common.sh@946 -- # '[' -z 3320856 ']' 00:05:32.503 14:53:13 -- common/autotest_common.sh@950 -- # kill -0 3320856 00:05:32.503 14:53:13 -- common/autotest_common.sh@951 -- # uname 00:05:32.503 14:53:13 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:32.503 14:53:13 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3320856 00:05:32.503 14:53:13 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:32.503 14:53:13 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:32.503 14:53:13 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3320856' 00:05:32.503 killing process with pid 3320856 00:05:32.503 14:53:13 -- common/autotest_common.sh@965 -- # kill 3320856 00:05:32.503 14:53:13 -- common/autotest_common.sh@970 -- # wait 3320856 00:05:32.769 14:53:13 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3320856 00:05:32.769 14:53:13 -- common/autotest_common.sh@648 -- # local es=0 00:05:32.769 14:53:13 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 3320856 00:05:32.769 14:53:13 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:05:32.769 14:53:13 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:32.769 14:53:13 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:05:32.769 14:53:13 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:32.769 14:53:13 -- common/autotest_common.sh@651 -- # waitforlisten 3320856 00:05:32.769 14:53:13 -- common/autotest_common.sh@827 -- # '[' -z 3320856 ']' 00:05:32.769 14:53:13 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.769 14:53:13 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:32.769 14:53:13 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.769 14:53:13 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:32.769 14:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:32.769 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (3320856) - No such process 00:05:32.769 ERROR: process (pid: 3320856) is no longer running 00:05:32.769 14:53:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:32.769 14:53:13 -- common/autotest_common.sh@860 -- # return 1 00:05:32.769 14:53:13 -- common/autotest_common.sh@651 -- # es=1 00:05:32.769 14:53:13 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:32.769 14:53:13 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:32.769 14:53:13 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:32.769 14:53:13 -- event/cpu_locks.sh@54 -- # no_locks 00:05:32.769 14:53:13 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:32.770 14:53:13 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:32.770 14:53:13 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:32.770 00:05:32.770 real 0m1.552s 00:05:32.770 user 0m1.661s 00:05:32.770 sys 0m0.507s 00:05:32.770 14:53:13 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:32.770 14:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:32.770 ************************************ 00:05:32.770 END TEST default_locks 00:05:32.770 ************************************ 00:05:32.770 14:53:13 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:32.770 14:53:13 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:32.770 14:53:13 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:32.770 14:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.030 ************************************ 00:05:33.030 START TEST default_locks_via_rpc 00:05:33.030 ************************************ 00:05:33.030 14:53:13 -- common/autotest_common.sh@1121 -- # default_locks_via_rpc 00:05:33.030 14:53:13 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3321231 00:05:33.030 14:53:13 -- event/cpu_locks.sh@63 -- # waitforlisten 3321231 00:05:33.030 14:53:13 -- common/autotest_common.sh@827 -- # '[' -z 3321231 ']' 00:05:33.030 14:53:13 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:33.030 14:53:13 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.030 14:53:13 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:33.030 14:53:13 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.030 14:53:13 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:33.030 14:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:33.030 [2024-04-26 14:53:13.783246] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:33.030 [2024-04-26 14:53:13.783306] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321231 ] 00:05:33.030 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.030 [2024-04-26 14:53:13.846767] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.030 [2024-04-26 14:53:13.916130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.603 14:53:14 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:33.603 14:53:14 -- common/autotest_common.sh@860 -- # return 0 00:05:33.603 14:53:14 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:33.603 14:53:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:33.603 14:53:14 -- common/autotest_common.sh@10 -- # set +x 00:05:33.603 14:53:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:33.603 14:53:14 -- event/cpu_locks.sh@67 -- # no_locks 00:05:33.603 14:53:14 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:33.603 14:53:14 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:33.603 14:53:14 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:33.603 14:53:14 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:33.603 14:53:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:33.603 14:53:14 -- common/autotest_common.sh@10 -- # set +x 00:05:33.603 14:53:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:33.603 14:53:14 -- event/cpu_locks.sh@71 -- # locks_exist 3321231 00:05:33.603 14:53:14 -- event/cpu_locks.sh@22 -- # lslocks -p 3321231 00:05:33.603 14:53:14 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:33.863 14:53:14 -- event/cpu_locks.sh@73 -- # killprocess 3321231 00:05:33.863 14:53:14 -- common/autotest_common.sh@946 -- # '[' -z 3321231 ']' 00:05:33.863 14:53:14 -- common/autotest_common.sh@950 -- # kill -0 3321231 00:05:33.863 14:53:14 -- common/autotest_common.sh@951 -- # uname 00:05:33.863 14:53:14 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:33.863 14:53:14 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3321231 00:05:33.863 14:53:14 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:33.863 14:53:14 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:33.863 14:53:14 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3321231' 00:05:33.863 killing process with pid 3321231 00:05:33.864 14:53:14 -- common/autotest_common.sh@965 -- # kill 3321231 00:05:33.864 14:53:14 -- common/autotest_common.sh@970 -- # wait 3321231 00:05:34.124 00:05:34.124 real 0m1.215s 00:05:34.124 user 0m1.289s 00:05:34.124 sys 0m0.378s 00:05:34.124 14:53:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:34.124 14:53:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.124 ************************************ 00:05:34.124 END TEST default_locks_via_rpc 00:05:34.124 ************************************ 00:05:34.124 14:53:14 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:34.124 14:53:14 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:34.124 14:53:14 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:34.124 14:53:14 -- common/autotest_common.sh@10 -- # set +x 00:05:34.385 ************************************ 00:05:34.385 START TEST non_locking_app_on_locked_coremask 00:05:34.385 ************************************ 00:05:34.385 14:53:15 -- common/autotest_common.sh@1121 -- # non_locking_app_on_locked_coremask 00:05:34.385 14:53:15 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3321597 00:05:34.385 14:53:15 -- event/cpu_locks.sh@81 -- # waitforlisten 3321597 /var/tmp/spdk.sock 00:05:34.385 14:53:15 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:34.385 14:53:15 -- common/autotest_common.sh@827 -- # '[' -z 3321597 ']' 00:05:34.385 14:53:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.385 14:53:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:34.385 14:53:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.385 14:53:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:34.385 14:53:15 -- common/autotest_common.sh@10 -- # set +x 00:05:34.385 [2024-04-26 14:53:15.170586] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:34.385 [2024-04-26 14:53:15.170642] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321597 ] 00:05:34.385 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.385 [2024-04-26 14:53:15.233011] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.385 [2024-04-26 14:53:15.305930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.328 14:53:15 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:35.328 14:53:15 -- common/autotest_common.sh@860 -- # return 0 00:05:35.328 14:53:15 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3321828 00:05:35.328 14:53:15 -- event/cpu_locks.sh@85 -- # waitforlisten 3321828 /var/tmp/spdk2.sock 00:05:35.328 14:53:15 -- common/autotest_common.sh@827 -- # '[' -z 3321828 ']' 00:05:35.328 14:53:15 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:35.328 14:53:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:35.328 14:53:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:35.328 14:53:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:35.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:35.328 14:53:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:35.328 14:53:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.328 [2024-04-26 14:53:15.988391] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:35.328 [2024-04-26 14:53:15.988459] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321828 ] 00:05:35.328 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.328 [2024-04-26 14:53:16.075585] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:35.328 [2024-04-26 14:53:16.075613] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.328 [2024-04-26 14:53:16.203121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.900 14:53:16 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:35.900 14:53:16 -- common/autotest_common.sh@860 -- # return 0 00:05:35.900 14:53:16 -- event/cpu_locks.sh@87 -- # locks_exist 3321597 00:05:35.900 14:53:16 -- event/cpu_locks.sh@22 -- # lslocks -p 3321597 00:05:35.900 14:53:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:36.472 lslocks: write error 00:05:36.472 14:53:17 -- event/cpu_locks.sh@89 -- # killprocess 3321597 00:05:36.472 14:53:17 -- common/autotest_common.sh@946 -- # '[' -z 3321597 ']' 00:05:36.472 14:53:17 -- common/autotest_common.sh@950 -- # kill -0 3321597 00:05:36.472 14:53:17 -- common/autotest_common.sh@951 -- # uname 00:05:36.472 14:53:17 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:36.472 14:53:17 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3321597 00:05:36.472 14:53:17 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:36.472 14:53:17 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:36.472 14:53:17 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3321597' 00:05:36.472 killing process with pid 3321597 00:05:36.472 14:53:17 -- common/autotest_common.sh@965 -- # kill 3321597 00:05:36.472 14:53:17 -- common/autotest_common.sh@970 -- # wait 3321597 00:05:37.043 14:53:17 -- event/cpu_locks.sh@90 -- # killprocess 3321828 00:05:37.043 14:53:17 -- common/autotest_common.sh@946 -- # '[' -z 3321828 ']' 00:05:37.043 14:53:17 -- common/autotest_common.sh@950 -- # kill -0 3321828 00:05:37.043 14:53:17 -- common/autotest_common.sh@951 -- # uname 00:05:37.043 14:53:17 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:37.043 14:53:17 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3321828 00:05:37.043 14:53:17 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:37.043 14:53:17 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:37.043 14:53:17 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3321828' 00:05:37.043 killing process with pid 3321828 00:05:37.043 14:53:17 -- common/autotest_common.sh@965 -- # kill 3321828 00:05:37.043 14:53:17 -- common/autotest_common.sh@970 -- # wait 3321828 00:05:37.305 00:05:37.305 real 0m2.907s 00:05:37.305 user 0m3.175s 00:05:37.305 sys 0m0.878s 00:05:37.305 14:53:18 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:37.305 14:53:18 -- common/autotest_common.sh@10 -- # set +x 00:05:37.305 ************************************ 00:05:37.305 END TEST non_locking_app_on_locked_coremask 00:05:37.305 ************************************ 00:05:37.305 14:53:18 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:37.305 14:53:18 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:37.305 14:53:18 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:37.305 14:53:18 -- common/autotest_common.sh@10 -- # set +x 00:05:37.305 ************************************ 00:05:37.305 START TEST locking_app_on_unlocked_coremask 00:05:37.305 ************************************ 00:05:37.305 14:53:18 -- common/autotest_common.sh@1121 -- # locking_app_on_unlocked_coremask 00:05:37.305 14:53:18 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3322309 00:05:37.305 14:53:18 -- event/cpu_locks.sh@99 -- # waitforlisten 3322309 /var/tmp/spdk.sock 00:05:37.305 14:53:18 -- common/autotest_common.sh@827 -- # '[' -z 3322309 ']' 00:05:37.305 14:53:18 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.305 14:53:18 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:37.305 14:53:18 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.305 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.305 14:53:18 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:37.305 14:53:18 -- common/autotest_common.sh@10 -- # set +x 00:05:37.305 14:53:18 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:37.305 [2024-04-26 14:53:18.234662] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:37.305 [2024-04-26 14:53:18.234726] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322309 ] 00:05:37.566 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.566 [2024-04-26 14:53:18.297490] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:37.566 [2024-04-26 14:53:18.297523] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.566 [2024-04-26 14:53:18.369899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.137 14:53:18 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:38.137 14:53:18 -- common/autotest_common.sh@860 -- # return 0 00:05:38.137 14:53:18 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3322373 00:05:38.137 14:53:18 -- event/cpu_locks.sh@103 -- # waitforlisten 3322373 /var/tmp/spdk2.sock 00:05:38.137 14:53:18 -- common/autotest_common.sh@827 -- # '[' -z 3322373 ']' 00:05:38.137 14:53:18 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:38.137 14:53:18 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:38.137 14:53:18 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:38.137 14:53:18 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:38.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:38.137 14:53:18 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:38.137 14:53:18 -- common/autotest_common.sh@10 -- # set +x 00:05:38.137 [2024-04-26 14:53:19.049415] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:38.137 [2024-04-26 14:53:19.049467] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322373 ] 00:05:38.137 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.398 [2024-04-26 14:53:19.137298] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.398 [2024-04-26 14:53:19.264645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.969 14:53:19 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:38.969 14:53:19 -- common/autotest_common.sh@860 -- # return 0 00:05:38.969 14:53:19 -- event/cpu_locks.sh@105 -- # locks_exist 3322373 00:05:38.969 14:53:19 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:38.969 14:53:19 -- event/cpu_locks.sh@22 -- # lslocks -p 3322373 00:05:39.230 lslocks: write error 00:05:39.230 14:53:20 -- event/cpu_locks.sh@107 -- # killprocess 3322309 00:05:39.230 14:53:20 -- common/autotest_common.sh@946 -- # '[' -z 3322309 ']' 00:05:39.230 14:53:20 -- common/autotest_common.sh@950 -- # kill -0 3322309 00:05:39.230 14:53:20 -- common/autotest_common.sh@951 -- # uname 00:05:39.230 14:53:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:39.230 14:53:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3322309 00:05:39.230 14:53:20 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:39.230 14:53:20 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:39.230 14:53:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3322309' 00:05:39.230 killing process with pid 3322309 00:05:39.230 14:53:20 -- common/autotest_common.sh@965 -- # kill 3322309 00:05:39.230 14:53:20 -- common/autotest_common.sh@970 -- # wait 3322309 00:05:39.802 14:53:20 -- event/cpu_locks.sh@108 -- # killprocess 3322373 00:05:39.802 14:53:20 -- common/autotest_common.sh@946 -- # '[' -z 3322373 ']' 00:05:39.802 14:53:20 -- common/autotest_common.sh@950 -- # kill -0 3322373 00:05:39.802 14:53:20 -- common/autotest_common.sh@951 -- # uname 00:05:39.802 14:53:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:39.802 14:53:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3322373 00:05:39.802 14:53:20 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:39.802 14:53:20 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:39.802 14:53:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3322373' 00:05:39.802 killing process with pid 3322373 00:05:39.802 14:53:20 -- common/autotest_common.sh@965 -- # kill 3322373 00:05:39.802 14:53:20 -- common/autotest_common.sh@970 -- # wait 3322373 00:05:40.064 00:05:40.064 real 0m2.642s 00:05:40.064 user 0m2.902s 00:05:40.064 sys 0m0.768s 00:05:40.064 14:53:20 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:40.064 14:53:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.064 ************************************ 00:05:40.064 END TEST locking_app_on_unlocked_coremask 00:05:40.064 ************************************ 00:05:40.064 14:53:20 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:40.064 14:53:20 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:40.064 14:53:20 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:40.064 14:53:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.064 ************************************ 00:05:40.064 START TEST locking_app_on_locked_coremask 00:05:40.064 ************************************ 00:05:40.064 14:53:20 -- common/autotest_common.sh@1121 -- # locking_app_on_locked_coremask 00:05:40.064 14:53:20 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3322908 00:05:40.064 14:53:20 -- event/cpu_locks.sh@116 -- # waitforlisten 3322908 /var/tmp/spdk.sock 00:05:40.064 14:53:20 -- common/autotest_common.sh@827 -- # '[' -z 3322908 ']' 00:05:40.064 14:53:20 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.064 14:53:20 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:40.064 14:53:20 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.064 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.064 14:53:20 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:40.064 14:53:20 -- common/autotest_common.sh@10 -- # set +x 00:05:40.064 14:53:20 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:40.324 [2024-04-26 14:53:21.032775] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:40.324 [2024-04-26 14:53:21.032824] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3322908 ] 00:05:40.324 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.324 [2024-04-26 14:53:21.092716] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.324 [2024-04-26 14:53:21.159097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.895 14:53:21 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:40.895 14:53:21 -- common/autotest_common.sh@860 -- # return 0 00:05:40.895 14:53:21 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3323031 00:05:40.895 14:53:21 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3323031 /var/tmp/spdk2.sock 00:05:40.895 14:53:21 -- common/autotest_common.sh@648 -- # local es=0 00:05:40.895 14:53:21 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:40.895 14:53:21 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 3323031 /var/tmp/spdk2.sock 00:05:40.895 14:53:21 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:05:40.895 14:53:21 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:40.895 14:53:21 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:05:40.895 14:53:21 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:40.895 14:53:21 -- common/autotest_common.sh@651 -- # waitforlisten 3323031 /var/tmp/spdk2.sock 00:05:40.895 14:53:21 -- common/autotest_common.sh@827 -- # '[' -z 3323031 ']' 00:05:40.895 14:53:21 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:40.895 14:53:21 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:40.895 14:53:21 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:40.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:40.895 14:53:21 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:40.895 14:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:40.895 [2024-04-26 14:53:21.844313] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:40.895 [2024-04-26 14:53:21.844365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323031 ] 00:05:41.156 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.156 [2024-04-26 14:53:21.929084] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3322908 has claimed it. 00:05:41.156 [2024-04-26 14:53:21.929120] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:41.728 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (3323031) - No such process 00:05:41.728 ERROR: process (pid: 3323031) is no longer running 00:05:41.728 14:53:22 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:41.728 14:53:22 -- common/autotest_common.sh@860 -- # return 1 00:05:41.728 14:53:22 -- common/autotest_common.sh@651 -- # es=1 00:05:41.728 14:53:22 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:41.728 14:53:22 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:41.728 14:53:22 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:41.728 14:53:22 -- event/cpu_locks.sh@122 -- # locks_exist 3322908 00:05:41.728 14:53:22 -- event/cpu_locks.sh@22 -- # lslocks -p 3322908 00:05:41.728 14:53:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:41.988 lslocks: write error 00:05:41.988 14:53:22 -- event/cpu_locks.sh@124 -- # killprocess 3322908 00:05:41.988 14:53:22 -- common/autotest_common.sh@946 -- # '[' -z 3322908 ']' 00:05:41.988 14:53:22 -- common/autotest_common.sh@950 -- # kill -0 3322908 00:05:41.988 14:53:22 -- common/autotest_common.sh@951 -- # uname 00:05:41.988 14:53:22 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:41.988 14:53:22 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3322908 00:05:41.988 14:53:22 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:41.988 14:53:22 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:41.988 14:53:22 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3322908' 00:05:41.988 killing process with pid 3322908 00:05:41.988 14:53:22 -- common/autotest_common.sh@965 -- # kill 3322908 00:05:41.988 14:53:22 -- common/autotest_common.sh@970 -- # wait 3322908 00:05:42.248 00:05:42.248 real 0m2.115s 00:05:42.248 user 0m2.330s 00:05:42.248 sys 0m0.591s 00:05:42.248 14:53:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:42.248 14:53:23 -- common/autotest_common.sh@10 -- # set +x 00:05:42.248 ************************************ 00:05:42.248 END TEST locking_app_on_locked_coremask 00:05:42.248 ************************************ 00:05:42.248 14:53:23 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:42.248 14:53:23 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:42.248 14:53:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:42.248 14:53:23 -- common/autotest_common.sh@10 -- # set +x 00:05:42.510 ************************************ 00:05:42.510 START TEST locking_overlapped_coremask 00:05:42.510 ************************************ 00:05:42.510 14:53:23 -- common/autotest_common.sh@1121 -- # locking_overlapped_coremask 00:05:42.510 14:53:23 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3323407 00:05:42.510 14:53:23 -- event/cpu_locks.sh@133 -- # waitforlisten 3323407 /var/tmp/spdk.sock 00:05:42.510 14:53:23 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:42.510 14:53:23 -- common/autotest_common.sh@827 -- # '[' -z 3323407 ']' 00:05:42.510 14:53:23 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.510 14:53:23 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:42.510 14:53:23 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.510 14:53:23 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:42.510 14:53:23 -- common/autotest_common.sh@10 -- # set +x 00:05:42.510 [2024-04-26 14:53:23.325716] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:42.510 [2024-04-26 14:53:23.325764] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323407 ] 00:05:42.510 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.510 [2024-04-26 14:53:23.386071] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:42.510 [2024-04-26 14:53:23.455486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:42.510 [2024-04-26 14:53:23.455622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.510 [2024-04-26 14:53:23.455625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.451 14:53:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:43.451 14:53:24 -- common/autotest_common.sh@860 -- # return 0 00:05:43.451 14:53:24 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3323496 00:05:43.451 14:53:24 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3323496 /var/tmp/spdk2.sock 00:05:43.451 14:53:24 -- common/autotest_common.sh@648 -- # local es=0 00:05:43.451 14:53:24 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:43.451 14:53:24 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 3323496 /var/tmp/spdk2.sock 00:05:43.451 14:53:24 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:05:43.451 14:53:24 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:43.451 14:53:24 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:05:43.451 14:53:24 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:43.451 14:53:24 -- common/autotest_common.sh@651 -- # waitforlisten 3323496 /var/tmp/spdk2.sock 00:05:43.451 14:53:24 -- common/autotest_common.sh@827 -- # '[' -z 3323496 ']' 00:05:43.451 14:53:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:43.451 14:53:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:43.451 14:53:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:43.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:43.451 14:53:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:43.451 14:53:24 -- common/autotest_common.sh@10 -- # set +x 00:05:43.451 [2024-04-26 14:53:24.146633] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:43.451 [2024-04-26 14:53:24.146683] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323496 ] 00:05:43.451 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.451 [2024-04-26 14:53:24.215845] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3323407 has claimed it. 00:05:43.451 [2024-04-26 14:53:24.215875] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:44.022 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (3323496) - No such process 00:05:44.022 ERROR: process (pid: 3323496) is no longer running 00:05:44.022 14:53:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:44.022 14:53:24 -- common/autotest_common.sh@860 -- # return 1 00:05:44.022 14:53:24 -- common/autotest_common.sh@651 -- # es=1 00:05:44.022 14:53:24 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:44.022 14:53:24 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:44.022 14:53:24 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:44.022 14:53:24 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:44.022 14:53:24 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:44.022 14:53:24 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:44.022 14:53:24 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:44.022 14:53:24 -- event/cpu_locks.sh@141 -- # killprocess 3323407 00:05:44.022 14:53:24 -- common/autotest_common.sh@946 -- # '[' -z 3323407 ']' 00:05:44.022 14:53:24 -- common/autotest_common.sh@950 -- # kill -0 3323407 00:05:44.022 14:53:24 -- common/autotest_common.sh@951 -- # uname 00:05:44.022 14:53:24 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:44.022 14:53:24 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3323407 00:05:44.022 14:53:24 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:44.022 14:53:24 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:44.022 14:53:24 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3323407' 00:05:44.022 killing process with pid 3323407 00:05:44.022 14:53:24 -- common/autotest_common.sh@965 -- # kill 3323407 00:05:44.022 14:53:24 -- common/autotest_common.sh@970 -- # wait 3323407 00:05:44.283 00:05:44.283 real 0m1.747s 00:05:44.283 user 0m4.965s 00:05:44.283 sys 0m0.356s 00:05:44.283 14:53:25 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:44.283 14:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:44.283 ************************************ 00:05:44.283 END TEST locking_overlapped_coremask 00:05:44.283 ************************************ 00:05:44.283 14:53:25 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:44.283 14:53:25 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:44.283 14:53:25 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:44.283 14:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:44.283 ************************************ 00:05:44.283 START TEST locking_overlapped_coremask_via_rpc 00:05:44.283 ************************************ 00:05:44.283 14:53:25 -- common/autotest_common.sh@1121 -- # locking_overlapped_coremask_via_rpc 00:05:44.283 14:53:25 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3323784 00:05:44.283 14:53:25 -- event/cpu_locks.sh@149 -- # waitforlisten 3323784 /var/tmp/spdk.sock 00:05:44.283 14:53:25 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:44.283 14:53:25 -- common/autotest_common.sh@827 -- # '[' -z 3323784 ']' 00:05:44.283 14:53:25 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.283 14:53:25 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:44.283 14:53:25 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.283 14:53:25 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:44.283 14:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:44.544 [2024-04-26 14:53:25.242558] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:44.544 [2024-04-26 14:53:25.242602] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323784 ] 00:05:44.544 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.544 [2024-04-26 14:53:25.303064] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:44.544 [2024-04-26 14:53:25.303091] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:44.544 [2024-04-26 14:53:25.366524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:44.544 [2024-04-26 14:53:25.366616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:44.544 [2024-04-26 14:53:25.366619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.115 14:53:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:45.115 14:53:25 -- common/autotest_common.sh@860 -- # return 0 00:05:45.115 14:53:25 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3323979 00:05:45.115 14:53:26 -- event/cpu_locks.sh@153 -- # waitforlisten 3323979 /var/tmp/spdk2.sock 00:05:45.115 14:53:26 -- common/autotest_common.sh@827 -- # '[' -z 3323979 ']' 00:05:45.115 14:53:26 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:45.115 14:53:26 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:45.115 14:53:26 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:45.115 14:53:26 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:45.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:45.115 14:53:26 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:45.115 14:53:26 -- common/autotest_common.sh@10 -- # set +x 00:05:45.115 [2024-04-26 14:53:26.053421] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:45.115 [2024-04-26 14:53:26.053475] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3323979 ] 00:05:45.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.375 [2024-04-26 14:53:26.128064] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:45.375 [2024-04-26 14:53:26.128088] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:45.375 [2024-04-26 14:53:26.228683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:45.375 [2024-04-26 14:53:26.232355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:45.375 [2024-04-26 14:53:26.232358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:45.943 14:53:26 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:45.943 14:53:26 -- common/autotest_common.sh@860 -- # return 0 00:05:45.943 14:53:26 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:45.943 14:53:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:45.943 14:53:26 -- common/autotest_common.sh@10 -- # set +x 00:05:45.943 14:53:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:45.943 14:53:26 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:45.943 14:53:26 -- common/autotest_common.sh@648 -- # local es=0 00:05:45.943 14:53:26 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:45.943 14:53:26 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:05:45.943 14:53:26 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:45.943 14:53:26 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:05:45.943 14:53:26 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:45.943 14:53:26 -- common/autotest_common.sh@651 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:45.943 14:53:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:45.943 14:53:26 -- common/autotest_common.sh@10 -- # set +x 00:05:45.943 [2024-04-26 14:53:26.828342] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3323784 has claimed it. 00:05:45.943 request: 00:05:45.943 { 00:05:45.943 "method": "framework_enable_cpumask_locks", 00:05:45.943 "req_id": 1 00:05:45.943 } 00:05:45.943 Got JSON-RPC error response 00:05:45.943 response: 00:05:45.943 { 00:05:45.943 "code": -32603, 00:05:45.943 "message": "Failed to claim CPU core: 2" 00:05:45.943 } 00:05:45.943 14:53:26 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:05:45.943 14:53:26 -- common/autotest_common.sh@651 -- # es=1 00:05:45.943 14:53:26 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:45.943 14:53:26 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:45.943 14:53:26 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:45.943 14:53:26 -- event/cpu_locks.sh@158 -- # waitforlisten 3323784 /var/tmp/spdk.sock 00:05:45.943 14:53:26 -- common/autotest_common.sh@827 -- # '[' -z 3323784 ']' 00:05:45.943 14:53:26 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:45.943 14:53:26 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:45.943 14:53:26 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:45.943 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:45.943 14:53:26 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:45.943 14:53:26 -- common/autotest_common.sh@10 -- # set +x 00:05:46.261 14:53:27 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:46.261 14:53:27 -- common/autotest_common.sh@860 -- # return 0 00:05:46.261 14:53:27 -- event/cpu_locks.sh@159 -- # waitforlisten 3323979 /var/tmp/spdk2.sock 00:05:46.261 14:53:27 -- common/autotest_common.sh@827 -- # '[' -z 3323979 ']' 00:05:46.261 14:53:27 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:46.261 14:53:27 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:46.261 14:53:27 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:46.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:46.261 14:53:27 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:46.261 14:53:27 -- common/autotest_common.sh@10 -- # set +x 00:05:46.520 14:53:27 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:46.520 14:53:27 -- common/autotest_common.sh@860 -- # return 0 00:05:46.520 14:53:27 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:46.520 14:53:27 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:46.520 14:53:27 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:46.520 14:53:27 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:46.520 00:05:46.520 real 0m1.972s 00:05:46.520 user 0m0.757s 00:05:46.520 sys 0m0.149s 00:05:46.520 14:53:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:46.520 14:53:27 -- common/autotest_common.sh@10 -- # set +x 00:05:46.520 ************************************ 00:05:46.520 END TEST locking_overlapped_coremask_via_rpc 00:05:46.520 ************************************ 00:05:46.520 14:53:27 -- event/cpu_locks.sh@174 -- # cleanup 00:05:46.520 14:53:27 -- event/cpu_locks.sh@15 -- # [[ -z 3323784 ]] 00:05:46.520 14:53:27 -- event/cpu_locks.sh@15 -- # killprocess 3323784 00:05:46.521 14:53:27 -- common/autotest_common.sh@946 -- # '[' -z 3323784 ']' 00:05:46.521 14:53:27 -- common/autotest_common.sh@950 -- # kill -0 3323784 00:05:46.521 14:53:27 -- common/autotest_common.sh@951 -- # uname 00:05:46.521 14:53:27 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:46.521 14:53:27 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3323784 00:05:46.521 14:53:27 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:46.521 14:53:27 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:46.521 14:53:27 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3323784' 00:05:46.521 killing process with pid 3323784 00:05:46.521 14:53:27 -- common/autotest_common.sh@965 -- # kill 3323784 00:05:46.521 14:53:27 -- common/autotest_common.sh@970 -- # wait 3323784 00:05:46.779 14:53:27 -- event/cpu_locks.sh@16 -- # [[ -z 3323979 ]] 00:05:46.780 14:53:27 -- event/cpu_locks.sh@16 -- # killprocess 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@946 -- # '[' -z 3323979 ']' 00:05:46.780 14:53:27 -- common/autotest_common.sh@950 -- # kill -0 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@951 -- # uname 00:05:46.780 14:53:27 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:46.780 14:53:27 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:05:46.780 14:53:27 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:05:46.780 14:53:27 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3323979' 00:05:46.780 killing process with pid 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@965 -- # kill 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@970 -- # wait 3323979 00:05:46.780 14:53:27 -- event/cpu_locks.sh@18 -- # rm -f 00:05:46.780 14:53:27 -- event/cpu_locks.sh@1 -- # cleanup 00:05:46.780 14:53:27 -- event/cpu_locks.sh@15 -- # [[ -z 3323784 ]] 00:05:46.780 14:53:27 -- event/cpu_locks.sh@15 -- # killprocess 3323784 00:05:46.780 14:53:27 -- common/autotest_common.sh@946 -- # '[' -z 3323784 ']' 00:05:46.780 14:53:27 -- common/autotest_common.sh@950 -- # kill -0 3323784 00:05:46.780 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 950: kill: (3323784) - No such process 00:05:46.780 14:53:27 -- common/autotest_common.sh@973 -- # echo 'Process with pid 3323784 is not found' 00:05:46.780 Process with pid 3323784 is not found 00:05:46.780 14:53:27 -- event/cpu_locks.sh@16 -- # [[ -z 3323979 ]] 00:05:46.780 14:53:27 -- event/cpu_locks.sh@16 -- # killprocess 3323979 00:05:46.780 14:53:27 -- common/autotest_common.sh@946 -- # '[' -z 3323979 ']' 00:05:46.780 14:53:27 -- common/autotest_common.sh@950 -- # kill -0 3323979 00:05:46.780 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 950: kill: (3323979) - No such process 00:05:46.780 14:53:27 -- common/autotest_common.sh@973 -- # echo 'Process with pid 3323979 is not found' 00:05:46.780 Process with pid 3323979 is not found 00:05:46.780 14:53:27 -- event/cpu_locks.sh@18 -- # rm -f 00:05:46.780 00:05:46.780 real 0m15.918s 00:05:46.780 user 0m26.822s 00:05:46.780 sys 0m4.727s 00:05:46.780 14:53:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:46.780 14:53:27 -- common/autotest_common.sh@10 -- # set +x 00:05:46.780 ************************************ 00:05:46.780 END TEST cpu_locks 00:05:46.780 ************************************ 00:05:47.039 00:05:47.039 real 0m43.274s 00:05:47.039 user 1m21.360s 00:05:47.039 sys 0m8.136s 00:05:47.039 14:53:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:47.039 14:53:27 -- common/autotest_common.sh@10 -- # set +x 00:05:47.039 ************************************ 00:05:47.039 END TEST event 00:05:47.039 ************************************ 00:05:47.039 14:53:27 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:05:47.039 14:53:27 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:47.039 14:53:27 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:47.039 14:53:27 -- common/autotest_common.sh@10 -- # set +x 00:05:47.039 ************************************ 00:05:47.039 START TEST thread 00:05:47.039 ************************************ 00:05:47.039 14:53:27 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:05:47.299 * Looking for test storage... 00:05:47.299 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:05:47.299 14:53:28 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:47.299 14:53:28 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:05:47.299 14:53:28 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:47.299 14:53:28 -- common/autotest_common.sh@10 -- # set +x 00:05:47.299 ************************************ 00:05:47.299 START TEST thread_poller_perf 00:05:47.299 ************************************ 00:05:47.299 14:53:28 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:47.299 [2024-04-26 14:53:28.196609] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:47.299 [2024-04-26 14:53:28.196721] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324566 ] 00:05:47.299 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.559 [2024-04-26 14:53:28.261960] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.559 [2024-04-26 14:53:28.332382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.559 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:48.497 ====================================== 00:05:48.497 busy:2409538174 (cyc) 00:05:48.497 total_run_count: 287000 00:05:48.497 tsc_hz: 2400000000 (cyc) 00:05:48.497 ====================================== 00:05:48.497 poller_cost: 8395 (cyc), 3497 (nsec) 00:05:48.497 00:05:48.497 real 0m1.218s 00:05:48.497 user 0m1.135s 00:05:48.497 sys 0m0.079s 00:05:48.497 14:53:29 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:48.497 14:53:29 -- common/autotest_common.sh@10 -- # set +x 00:05:48.497 ************************************ 00:05:48.497 END TEST thread_poller_perf 00:05:48.497 ************************************ 00:05:48.497 14:53:29 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:48.497 14:53:29 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:05:48.497 14:53:29 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:48.497 14:53:29 -- common/autotest_common.sh@10 -- # set +x 00:05:48.758 ************************************ 00:05:48.758 START TEST thread_poller_perf 00:05:48.758 ************************************ 00:05:48.758 14:53:29 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:48.758 [2024-04-26 14:53:29.601929] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:48.758 [2024-04-26 14:53:29.602028] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324925 ] 00:05:48.758 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.758 [2024-04-26 14:53:29.667903] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.018 [2024-04-26 14:53:29.738887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.018 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:49.958 ====================================== 00:05:49.958 busy:2402227570 (cyc) 00:05:49.958 total_run_count: 3811000 00:05:49.958 tsc_hz: 2400000000 (cyc) 00:05:49.958 ====================================== 00:05:49.958 poller_cost: 630 (cyc), 262 (nsec) 00:05:49.958 00:05:49.958 real 0m1.215s 00:05:49.958 user 0m1.139s 00:05:49.958 sys 0m0.071s 00:05:49.958 14:53:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:49.958 14:53:30 -- common/autotest_common.sh@10 -- # set +x 00:05:49.958 ************************************ 00:05:49.958 END TEST thread_poller_perf 00:05:49.958 ************************************ 00:05:49.958 14:53:30 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:49.958 00:05:49.958 real 0m2.895s 00:05:49.958 user 0m2.459s 00:05:49.958 sys 0m0.403s 00:05:49.958 14:53:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:49.958 14:53:30 -- common/autotest_common.sh@10 -- # set +x 00:05:49.958 ************************************ 00:05:49.958 END TEST thread 00:05:49.958 ************************************ 00:05:49.958 14:53:30 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:05:49.958 14:53:30 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:49.958 14:53:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:49.958 14:53:30 -- common/autotest_common.sh@10 -- # set +x 00:05:50.219 ************************************ 00:05:50.219 START TEST accel 00:05:50.219 ************************************ 00:05:50.219 14:53:31 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:05:50.219 * Looking for test storage... 00:05:50.219 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:05:50.219 14:53:31 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:05:50.219 14:53:31 -- accel/accel.sh@82 -- # get_expected_opcs 00:05:50.219 14:53:31 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:50.219 14:53:31 -- accel/accel.sh@62 -- # spdk_tgt_pid=3325229 00:05:50.219 14:53:31 -- accel/accel.sh@63 -- # waitforlisten 3325229 00:05:50.219 14:53:31 -- common/autotest_common.sh@827 -- # '[' -z 3325229 ']' 00:05:50.219 14:53:31 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:50.219 14:53:31 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:50.219 14:53:31 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:50.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:50.219 14:53:31 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:50.219 14:53:31 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:50.219 14:53:31 -- accel/accel.sh@61 -- # build_accel_config 00:05:50.219 14:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:50.219 14:53:31 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:50.219 14:53:31 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:50.219 14:53:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.219 14:53:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.219 14:53:31 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:50.219 14:53:31 -- accel/accel.sh@40 -- # local IFS=, 00:05:50.219 14:53:31 -- accel/accel.sh@41 -- # jq -r . 00:05:50.480 [2024-04-26 14:53:31.170058] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:50.480 [2024-04-26 14:53:31.170122] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325229 ] 00:05:50.480 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.480 [2024-04-26 14:53:31.233507] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.480 [2024-04-26 14:53:31.306432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.053 14:53:31 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:51.053 14:53:31 -- common/autotest_common.sh@860 -- # return 0 00:05:51.053 14:53:31 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:05:51.053 14:53:31 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:05:51.053 14:53:31 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:05:51.053 14:53:31 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:05:51.053 14:53:31 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:51.053 14:53:31 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:05:51.053 14:53:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:51.053 14:53:31 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:51.053 14:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:51.053 14:53:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.053 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.053 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.053 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.054 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.054 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.054 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.054 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.054 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.054 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.054 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.054 14:53:31 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # IFS== 00:05:51.054 14:53:31 -- accel/accel.sh@72 -- # read -r opc module 00:05:51.054 14:53:31 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:51.054 14:53:31 -- accel/accel.sh@75 -- # killprocess 3325229 00:05:51.054 14:53:31 -- common/autotest_common.sh@946 -- # '[' -z 3325229 ']' 00:05:51.054 14:53:31 -- common/autotest_common.sh@950 -- # kill -0 3325229 00:05:51.054 14:53:31 -- common/autotest_common.sh@951 -- # uname 00:05:51.054 14:53:31 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:51.054 14:53:32 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3325229 00:05:51.314 14:53:32 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:51.314 14:53:32 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:51.314 14:53:32 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3325229' 00:05:51.314 killing process with pid 3325229 00:05:51.314 14:53:32 -- common/autotest_common.sh@965 -- # kill 3325229 00:05:51.314 14:53:32 -- common/autotest_common.sh@970 -- # wait 3325229 00:05:51.314 14:53:32 -- accel/accel.sh@76 -- # trap - ERR 00:05:51.314 14:53:32 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:05:51.314 14:53:32 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:05:51.314 14:53:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:51.314 14:53:32 -- common/autotest_common.sh@10 -- # set +x 00:05:51.577 14:53:32 -- common/autotest_common.sh@1121 -- # accel_perf -h 00:05:51.577 14:53:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:51.577 14:53:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.577 14:53:32 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:51.577 14:53:32 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:51.577 14:53:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.577 14:53:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.577 14:53:32 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:51.577 14:53:32 -- accel/accel.sh@40 -- # local IFS=, 00:05:51.577 14:53:32 -- accel/accel.sh@41 -- # jq -r . 00:05:51.577 14:53:32 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:51.577 14:53:32 -- common/autotest_common.sh@10 -- # set +x 00:05:51.577 14:53:32 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:51.577 14:53:32 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:05:51.577 14:53:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:51.577 14:53:32 -- common/autotest_common.sh@10 -- # set +x 00:05:51.841 ************************************ 00:05:51.841 START TEST accel_missing_filename 00:05:51.841 ************************************ 00:05:51.841 14:53:32 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w compress 00:05:51.841 14:53:32 -- common/autotest_common.sh@648 -- # local es=0 00:05:51.841 14:53:32 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:51.841 14:53:32 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:05:51.841 14:53:32 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:51.841 14:53:32 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:05:51.841 14:53:32 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:51.841 14:53:32 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w compress 00:05:51.841 14:53:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:51.841 14:53:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.841 14:53:32 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:51.841 14:53:32 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:51.841 14:53:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.841 14:53:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.841 14:53:32 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:51.841 14:53:32 -- accel/accel.sh@40 -- # local IFS=, 00:05:51.841 14:53:32 -- accel/accel.sh@41 -- # jq -r . 00:05:51.841 [2024-04-26 14:53:32.609400] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:51.841 [2024-04-26 14:53:32.609491] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325538 ] 00:05:51.841 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.841 [2024-04-26 14:53:32.678496] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.841 [2024-04-26 14:53:32.741147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.841 [2024-04-26 14:53:32.773383] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:52.102 [2024-04-26 14:53:32.810570] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:52.102 A filename is required. 00:05:52.102 14:53:32 -- common/autotest_common.sh@651 -- # es=234 00:05:52.102 14:53:32 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:52.102 14:53:32 -- common/autotest_common.sh@660 -- # es=106 00:05:52.102 14:53:32 -- common/autotest_common.sh@661 -- # case "$es" in 00:05:52.102 14:53:32 -- common/autotest_common.sh@668 -- # es=1 00:05:52.102 14:53:32 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:52.102 00:05:52.102 real 0m0.285s 00:05:52.102 user 0m0.213s 00:05:52.102 sys 0m0.112s 00:05:52.102 14:53:32 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:52.102 14:53:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.102 ************************************ 00:05:52.102 END TEST accel_missing_filename 00:05:52.102 ************************************ 00:05:52.102 14:53:32 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:52.102 14:53:32 -- common/autotest_common.sh@1097 -- # '[' 10 -le 1 ']' 00:05:52.102 14:53:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:52.102 14:53:32 -- common/autotest_common.sh@10 -- # set +x 00:05:52.102 ************************************ 00:05:52.102 START TEST accel_compress_verify 00:05:52.102 ************************************ 00:05:52.102 14:53:33 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:52.102 14:53:33 -- common/autotest_common.sh@648 -- # local es=0 00:05:52.102 14:53:33 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:52.102 14:53:33 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:05:52.102 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.102 14:53:33 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:05:52.102 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.102 14:53:33 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:52.102 14:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:52.102 14:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.102 14:53:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:52.102 14:53:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:52.102 14:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.102 14:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.102 14:53:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:52.102 14:53:33 -- accel/accel.sh@40 -- # local IFS=, 00:05:52.102 14:53:33 -- accel/accel.sh@41 -- # jq -r . 00:05:52.363 [2024-04-26 14:53:33.055226] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:52.363 [2024-04-26 14:53:33.055273] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325745 ] 00:05:52.363 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.363 [2024-04-26 14:53:33.111979] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.363 [2024-04-26 14:53:33.173453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.363 [2024-04-26 14:53:33.205368] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:52.363 [2024-04-26 14:53:33.242186] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:52.363 00:05:52.363 Compression does not support the verify option, aborting. 00:05:52.363 14:53:33 -- common/autotest_common.sh@651 -- # es=161 00:05:52.363 14:53:33 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:52.363 14:53:33 -- common/autotest_common.sh@660 -- # es=33 00:05:52.363 14:53:33 -- common/autotest_common.sh@661 -- # case "$es" in 00:05:52.363 14:53:33 -- common/autotest_common.sh@668 -- # es=1 00:05:52.363 14:53:33 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:52.363 00:05:52.363 real 0m0.256s 00:05:52.363 user 0m0.209s 00:05:52.363 sys 0m0.090s 00:05:52.363 14:53:33 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:52.363 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.363 ************************************ 00:05:52.363 END TEST accel_compress_verify 00:05:52.363 ************************************ 00:05:52.623 14:53:33 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:52.623 14:53:33 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:05:52.623 14:53:33 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:52.623 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.623 ************************************ 00:05:52.623 START TEST accel_wrong_workload 00:05:52.623 ************************************ 00:05:52.623 14:53:33 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w foobar 00:05:52.623 14:53:33 -- common/autotest_common.sh@648 -- # local es=0 00:05:52.623 14:53:33 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:52.623 14:53:33 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:05:52.623 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.623 14:53:33 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:05:52.623 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.623 14:53:33 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w foobar 00:05:52.623 14:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:52.623 14:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.623 14:53:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:52.623 14:53:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:52.623 14:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.623 14:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.623 14:53:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:52.623 14:53:33 -- accel/accel.sh@40 -- # local IFS=, 00:05:52.623 14:53:33 -- accel/accel.sh@41 -- # jq -r . 00:05:52.623 Unsupported workload type: foobar 00:05:52.623 [2024-04-26 14:53:33.499808] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:52.623 accel_perf options: 00:05:52.623 [-h help message] 00:05:52.623 [-q queue depth per core] 00:05:52.623 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:52.623 [-T number of threads per core 00:05:52.623 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:52.623 [-t time in seconds] 00:05:52.623 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:52.623 [ dif_verify, , dif_generate, dif_generate_copy 00:05:52.623 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:52.623 [-l for compress/decompress workloads, name of uncompressed input file 00:05:52.623 [-S for crc32c workload, use this seed value (default 0) 00:05:52.623 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:52.623 [-f for fill workload, use this BYTE value (default 255) 00:05:52.623 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:52.623 [-y verify result if this switch is on] 00:05:52.623 [-a tasks to allocate per core (default: same value as -q)] 00:05:52.623 Can be used to spread operations across a wider range of memory. 00:05:52.623 14:53:33 -- common/autotest_common.sh@651 -- # es=1 00:05:52.623 14:53:33 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:52.623 14:53:33 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:52.623 14:53:33 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:52.623 00:05:52.623 real 0m0.035s 00:05:52.623 user 0m0.019s 00:05:52.623 sys 0m0.016s 00:05:52.623 14:53:33 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:52.623 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.623 ************************************ 00:05:52.623 END TEST accel_wrong_workload 00:05:52.623 ************************************ 00:05:52.623 Error: writing output failed: Broken pipe 00:05:52.623 14:53:33 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:52.623 14:53:33 -- common/autotest_common.sh@1097 -- # '[' 10 -le 1 ']' 00:05:52.623 14:53:33 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:52.623 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.909 ************************************ 00:05:52.909 START TEST accel_negative_buffers 00:05:52.909 ************************************ 00:05:52.909 14:53:33 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:52.909 14:53:33 -- common/autotest_common.sh@648 -- # local es=0 00:05:52.909 14:53:33 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:52.909 14:53:33 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:05:52.909 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.909 14:53:33 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:05:52.909 14:53:33 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:52.909 14:53:33 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w xor -y -x -1 00:05:52.909 14:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:52.909 14:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.909 14:53:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:52.909 14:53:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:52.909 14:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.909 14:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.909 14:53:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:52.909 14:53:33 -- accel/accel.sh@40 -- # local IFS=, 00:05:52.909 14:53:33 -- accel/accel.sh@41 -- # jq -r . 00:05:52.909 -x option must be non-negative. 00:05:52.909 [2024-04-26 14:53:33.709754] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:52.909 accel_perf options: 00:05:52.909 [-h help message] 00:05:52.909 [-q queue depth per core] 00:05:52.909 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:52.909 [-T number of threads per core 00:05:52.909 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:52.909 [-t time in seconds] 00:05:52.909 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:52.909 [ dif_verify, , dif_generate, dif_generate_copy 00:05:52.909 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:52.909 [-l for compress/decompress workloads, name of uncompressed input file 00:05:52.909 [-S for crc32c workload, use this seed value (default 0) 00:05:52.909 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:52.909 [-f for fill workload, use this BYTE value (default 255) 00:05:52.909 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:52.909 [-y verify result if this switch is on] 00:05:52.909 [-a tasks to allocate per core (default: same value as -q)] 00:05:52.909 Can be used to spread operations across a wider range of memory. 00:05:52.909 14:53:33 -- common/autotest_common.sh@651 -- # es=1 00:05:52.909 14:53:33 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:52.909 14:53:33 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:52.909 14:53:33 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:52.909 00:05:52.909 real 0m0.035s 00:05:52.909 user 0m0.027s 00:05:52.909 sys 0m0.008s 00:05:52.909 14:53:33 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:52.909 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.909 ************************************ 00:05:52.909 END TEST accel_negative_buffers 00:05:52.909 ************************************ 00:05:52.909 Error: writing output failed: Broken pipe 00:05:52.909 14:53:33 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:52.909 14:53:33 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:05:52.909 14:53:33 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:52.909 14:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:53.169 ************************************ 00:05:53.169 START TEST accel_crc32c 00:05:53.169 ************************************ 00:05:53.169 14:53:33 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:53.169 14:53:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.169 14:53:33 -- accel/accel.sh@17 -- # local accel_module 00:05:53.169 14:53:33 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:33 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:53.169 14:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:53.169 14:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.169 14:53:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:53.169 14:53:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:53.169 14:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.169 14:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.169 14:53:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:53.169 14:53:33 -- accel/accel.sh@40 -- # local IFS=, 00:05:53.169 14:53:33 -- accel/accel.sh@41 -- # jq -r . 00:05:53.169 [2024-04-26 14:53:33.926685] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:53.169 [2024-04-26 14:53:33.926752] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325837 ] 00:05:53.169 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.169 [2024-04-26 14:53:33.989177] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.169 [2024-04-26 14:53:34.056876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.169 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.169 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val=0x1 00:05:53.169 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.169 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.169 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.169 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.169 14:53:34 -- accel/accel.sh@20 -- # val=crc32c 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=32 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=software 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@22 -- # accel_module=software 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=32 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=32 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=1 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val=Yes 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:53.170 14:53:34 -- accel/accel.sh@20 -- # val= 00:05:53.170 14:53:34 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # IFS=: 00:05:53.170 14:53:34 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.553 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:54.553 14:53:35 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:54.553 14:53:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.553 00:05:54.553 real 0m1.288s 00:05:54.553 user 0m1.200s 00:05:54.553 sys 0m0.099s 00:05:54.553 14:53:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:54.553 14:53:35 -- common/autotest_common.sh@10 -- # set +x 00:05:54.553 ************************************ 00:05:54.553 END TEST accel_crc32c 00:05:54.553 ************************************ 00:05:54.553 14:53:35 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:54.553 14:53:35 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:05:54.553 14:53:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:54.553 14:53:35 -- common/autotest_common.sh@10 -- # set +x 00:05:54.553 ************************************ 00:05:54.553 START TEST accel_crc32c_C2 00:05:54.553 ************************************ 00:05:54.553 14:53:35 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:54.553 14:53:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.553 14:53:35 -- accel/accel.sh@17 -- # local accel_module 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.553 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.553 14:53:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:54.553 14:53:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:54.553 14:53:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.553 14:53:35 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:54.553 14:53:35 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:54.553 14:53:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.553 14:53:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.553 14:53:35 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:54.553 14:53:35 -- accel/accel.sh@40 -- # local IFS=, 00:05:54.553 14:53:35 -- accel/accel.sh@41 -- # jq -r . 00:05:54.553 [2024-04-26 14:53:35.394322] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:54.553 [2024-04-26 14:53:35.394414] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326190 ] 00:05:54.553 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.553 [2024-04-26 14:53:35.457872] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.814 [2024-04-26 14:53:35.526376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=0x1 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=crc32c 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=0 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=software 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@22 -- # accel_module=software 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=32 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=32 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=1 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val=Yes 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:54.814 14:53:35 -- accel/accel.sh@20 -- # val= 00:05:54.814 14:53:35 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # IFS=: 00:05:54.814 14:53:35 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@20 -- # val= 00:05:55.755 14:53:36 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:55.755 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:55.755 14:53:36 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:55.755 14:53:36 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:55.755 14:53:36 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.755 00:05:55.755 real 0m1.290s 00:05:55.755 user 0m1.197s 00:05:55.755 sys 0m0.103s 00:05:55.755 14:53:36 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:55.755 14:53:36 -- common/autotest_common.sh@10 -- # set +x 00:05:55.755 ************************************ 00:05:55.755 END TEST accel_crc32c_C2 00:05:55.755 ************************************ 00:05:55.755 14:53:36 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:55.755 14:53:36 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:05:55.755 14:53:36 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:55.755 14:53:36 -- common/autotest_common.sh@10 -- # set +x 00:05:56.016 ************************************ 00:05:56.016 START TEST accel_copy 00:05:56.016 ************************************ 00:05:56.016 14:53:36 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy -y 00:05:56.016 14:53:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.016 14:53:36 -- accel/accel.sh@17 -- # local accel_module 00:05:56.016 14:53:36 -- accel/accel.sh@19 -- # IFS=: 00:05:56.016 14:53:36 -- accel/accel.sh@19 -- # read -r var val 00:05:56.016 14:53:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:56.016 14:53:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:56.016 14:53:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.016 14:53:36 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:56.016 14:53:36 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:56.016 14:53:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.016 14:53:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.016 14:53:36 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:56.016 14:53:36 -- accel/accel.sh@40 -- # local IFS=, 00:05:56.016 14:53:36 -- accel/accel.sh@41 -- # jq -r . 00:05:56.016 [2024-04-26 14:53:36.864391] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:56.016 [2024-04-26 14:53:36.864450] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326551 ] 00:05:56.016 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.016 [2024-04-26 14:53:36.927427] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.301 [2024-04-26 14:53:36.996146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val=0x1 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val=copy 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@23 -- # accel_opc=copy 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val=software 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@22 -- # accel_module=software 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.301 14:53:37 -- accel/accel.sh@20 -- # val=32 00:05:56.301 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.301 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val=32 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val=1 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val=Yes 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:56.302 14:53:37 -- accel/accel.sh@20 -- # val= 00:05:56.302 14:53:37 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # IFS=: 00:05:56.302 14:53:37 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.290 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.290 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.290 14:53:38 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:57.290 14:53:38 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:05:57.290 14:53:38 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.290 00:05:57.290 real 0m1.289s 00:05:57.290 user 0m1.197s 00:05:57.290 sys 0m0.101s 00:05:57.290 14:53:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:57.290 14:53:38 -- common/autotest_common.sh@10 -- # set +x 00:05:57.290 ************************************ 00:05:57.290 END TEST accel_copy 00:05:57.290 ************************************ 00:05:57.290 14:53:38 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:57.290 14:53:38 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:05:57.290 14:53:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:57.290 14:53:38 -- common/autotest_common.sh@10 -- # set +x 00:05:57.551 ************************************ 00:05:57.551 START TEST accel_fill 00:05:57.551 ************************************ 00:05:57.551 14:53:38 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:57.551 14:53:38 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.551 14:53:38 -- accel/accel.sh@17 -- # local accel_module 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:57.551 14:53:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:57.551 14:53:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.551 14:53:38 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:57.551 14:53:38 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:57.551 14:53:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.551 14:53:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.551 14:53:38 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:57.551 14:53:38 -- accel/accel.sh@40 -- # local IFS=, 00:05:57.551 14:53:38 -- accel/accel.sh@41 -- # jq -r . 00:05:57.551 [2024-04-26 14:53:38.336009] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:57.551 [2024-04-26 14:53:38.336099] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326916 ] 00:05:57.551 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.551 [2024-04-26 14:53:38.398449] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.551 [2024-04-26 14:53:38.463034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val=0x1 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val=fill 00:05:57.551 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.551 14:53:38 -- accel/accel.sh@23 -- # accel_opc=fill 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.551 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.551 14:53:38 -- accel/accel.sh@20 -- # val=0x80 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val=software 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@22 -- # accel_module=software 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val=64 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val=64 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val=1 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val=Yes 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:57.811 14:53:38 -- accel/accel.sh@20 -- # val= 00:05:57.811 14:53:38 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # IFS=: 00:05:57.811 14:53:38 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:58.751 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:58.751 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:58.751 14:53:39 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:58.751 14:53:39 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:05:58.751 14:53:39 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.751 00:05:58.751 real 0m1.285s 00:05:58.751 user 0m1.196s 00:05:58.751 sys 0m0.099s 00:05:58.751 14:53:39 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:58.751 14:53:39 -- common/autotest_common.sh@10 -- # set +x 00:05:58.751 ************************************ 00:05:58.751 END TEST accel_fill 00:05:58.751 ************************************ 00:05:58.751 14:53:39 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:58.751 14:53:39 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:05:58.751 14:53:39 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:58.751 14:53:39 -- common/autotest_common.sh@10 -- # set +x 00:05:59.012 ************************************ 00:05:59.012 START TEST accel_copy_crc32c 00:05:59.012 ************************************ 00:05:59.012 14:53:39 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy_crc32c -y 00:05:59.012 14:53:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.012 14:53:39 -- accel/accel.sh@17 -- # local accel_module 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:59.012 14:53:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:59.012 14:53:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.012 14:53:39 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:59.012 14:53:39 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:59.012 14:53:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.012 14:53:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.012 14:53:39 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:59.012 14:53:39 -- accel/accel.sh@40 -- # local IFS=, 00:05:59.012 14:53:39 -- accel/accel.sh@41 -- # jq -r . 00:05:59.012 [2024-04-26 14:53:39.796013] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:05:59.012 [2024-04-26 14:53:39.796077] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327277 ] 00:05:59.012 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.012 [2024-04-26 14:53:39.857214] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.012 [2024-04-26 14:53:39.922099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val=0x1 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val=0 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:59.012 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.012 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.012 14:53:39 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val=software 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@22 -- # accel_module=software 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val=32 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val=32 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val=1 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val=Yes 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:05:59.272 14:53:39 -- accel/accel.sh@20 -- # val= 00:05:59.272 14:53:39 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # IFS=: 00:05:59.272 14:53:39 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.210 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.210 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.210 14:53:41 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:00.210 14:53:41 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:00.210 14:53:41 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.210 00:06:00.210 real 0m1.282s 00:06:00.210 user 0m1.202s 00:06:00.210 sys 0m0.092s 00:06:00.210 14:53:41 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:00.210 14:53:41 -- common/autotest_common.sh@10 -- # set +x 00:06:00.210 ************************************ 00:06:00.210 END TEST accel_copy_crc32c 00:06:00.210 ************************************ 00:06:00.210 14:53:41 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:00.210 14:53:41 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:00.210 14:53:41 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:00.210 14:53:41 -- common/autotest_common.sh@10 -- # set +x 00:06:00.471 ************************************ 00:06:00.471 START TEST accel_copy_crc32c_C2 00:06:00.471 ************************************ 00:06:00.471 14:53:41 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:00.471 14:53:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.471 14:53:41 -- accel/accel.sh@17 -- # local accel_module 00:06:00.471 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.471 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.471 14:53:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:00.471 14:53:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:00.471 14:53:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.471 14:53:41 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:00.471 14:53:41 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:00.471 14:53:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.471 14:53:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.471 14:53:41 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:00.471 14:53:41 -- accel/accel.sh@40 -- # local IFS=, 00:06:00.471 14:53:41 -- accel/accel.sh@41 -- # jq -r . 00:06:00.471 [2024-04-26 14:53:41.259721] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:00.471 [2024-04-26 14:53:41.259785] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327609 ] 00:06:00.471 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.471 [2024-04-26 14:53:41.324426] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.471 [2024-04-26 14:53:41.394158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=0x1 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=copy_crc32c 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=0 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val='8192 bytes' 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=software 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@22 -- # accel_module=software 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=32 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=32 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val=1 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.731 14:53:41 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:00.731 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.731 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.732 14:53:41 -- accel/accel.sh@20 -- # val=Yes 00:06:00.732 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.732 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.732 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:00.732 14:53:41 -- accel/accel.sh@20 -- # val= 00:06:00.732 14:53:41 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # IFS=: 00:06:00.732 14:53:41 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:01.672 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.672 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.672 14:53:42 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:01.672 14:53:42 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:01.672 14:53:42 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.672 00:06:01.672 real 0m1.293s 00:06:01.672 user 0m1.200s 00:06:01.672 sys 0m0.104s 00:06:01.672 14:53:42 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:01.672 14:53:42 -- common/autotest_common.sh@10 -- # set +x 00:06:01.672 ************************************ 00:06:01.672 END TEST accel_copy_crc32c_C2 00:06:01.672 ************************************ 00:06:01.672 14:53:42 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:01.672 14:53:42 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:01.672 14:53:42 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:01.672 14:53:42 -- common/autotest_common.sh@10 -- # set +x 00:06:01.931 ************************************ 00:06:01.931 START TEST accel_dualcast 00:06:01.931 ************************************ 00:06:01.931 14:53:42 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dualcast -y 00:06:01.931 14:53:42 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.931 14:53:42 -- accel/accel.sh@17 -- # local accel_module 00:06:01.932 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:01.932 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:01.932 14:53:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:01.932 14:53:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:01.932 14:53:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.932 14:53:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:01.932 14:53:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:01.932 14:53:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.932 14:53:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.932 14:53:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:01.932 14:53:42 -- accel/accel.sh@40 -- # local IFS=, 00:06:01.932 14:53:42 -- accel/accel.sh@41 -- # jq -r . 00:06:01.932 [2024-04-26 14:53:42.728788] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:01.932 [2024-04-26 14:53:42.728853] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327861 ] 00:06:01.932 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.932 [2024-04-26 14:53:42.792948] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.932 [2024-04-26 14:53:42.865506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.191 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.191 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.191 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.191 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=0x1 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=dualcast 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=software 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@22 -- # accel_module=software 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=32 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=32 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=1 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val=Yes 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:02.192 14:53:42 -- accel/accel.sh@20 -- # val= 00:06:02.192 14:53:42 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # IFS=: 00:06:02.192 14:53:42 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@20 -- # val= 00:06:03.132 14:53:43 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # IFS=: 00:06:03.132 14:53:43 -- accel/accel.sh@19 -- # read -r var val 00:06:03.132 14:53:43 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:03.132 14:53:43 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:06:03.132 14:53:43 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.132 00:06:03.132 real 0m1.293s 00:06:03.132 user 0m1.196s 00:06:03.132 sys 0m0.107s 00:06:03.132 14:53:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:03.132 14:53:43 -- common/autotest_common.sh@10 -- # set +x 00:06:03.132 ************************************ 00:06:03.132 END TEST accel_dualcast 00:06:03.132 ************************************ 00:06:03.132 14:53:44 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:03.132 14:53:44 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:03.132 14:53:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:03.132 14:53:44 -- common/autotest_common.sh@10 -- # set +x 00:06:03.392 ************************************ 00:06:03.392 START TEST accel_compare 00:06:03.392 ************************************ 00:06:03.392 14:53:44 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w compare -y 00:06:03.392 14:53:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.392 14:53:44 -- accel/accel.sh@17 -- # local accel_module 00:06:03.392 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.392 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.392 14:53:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:03.392 14:53:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:03.392 14:53:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.392 14:53:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:03.392 14:53:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:03.392 14:53:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.392 14:53:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.392 14:53:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:03.392 14:53:44 -- accel/accel.sh@40 -- # local IFS=, 00:06:03.392 14:53:44 -- accel/accel.sh@41 -- # jq -r . 00:06:03.392 [2024-04-26 14:53:44.205114] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:03.392 [2024-04-26 14:53:44.205190] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328105 ] 00:06:03.392 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.392 [2024-04-26 14:53:44.269309] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.392 [2024-04-26 14:53:44.341951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=0x1 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=compare 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@23 -- # accel_opc=compare 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=software 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@22 -- # accel_module=software 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=32 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=32 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=1 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val=Yes 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:03.653 14:53:44 -- accel/accel.sh@20 -- # val= 00:06:03.653 14:53:44 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # IFS=: 00:06:03.653 14:53:44 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:04.595 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.595 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.595 14:53:45 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:04.595 14:53:45 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:06:04.595 14:53:45 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.595 00:06:04.595 real 0m1.295s 00:06:04.595 user 0m1.205s 00:06:04.595 sys 0m0.100s 00:06:04.595 14:53:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:04.595 14:53:45 -- common/autotest_common.sh@10 -- # set +x 00:06:04.595 ************************************ 00:06:04.595 END TEST accel_compare 00:06:04.595 ************************************ 00:06:04.595 14:53:45 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:04.595 14:53:45 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:04.595 14:53:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:04.595 14:53:45 -- common/autotest_common.sh@10 -- # set +x 00:06:04.856 ************************************ 00:06:04.856 START TEST accel_xor 00:06:04.856 ************************************ 00:06:04.856 14:53:45 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w xor -y 00:06:04.856 14:53:45 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.856 14:53:45 -- accel/accel.sh@17 -- # local accel_module 00:06:04.856 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:04.856 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:04.856 14:53:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:04.856 14:53:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:04.856 14:53:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.856 14:53:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:04.856 14:53:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:04.856 14:53:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.856 14:53:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.856 14:53:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:04.856 14:53:45 -- accel/accel.sh@40 -- # local IFS=, 00:06:04.856 14:53:45 -- accel/accel.sh@41 -- # jq -r . 00:06:04.856 [2024-04-26 14:53:45.674673] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:04.856 [2024-04-26 14:53:45.674750] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328401 ] 00:06:04.856 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.856 [2024-04-26 14:53:45.738775] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.117 [2024-04-26 14:53:45.808525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=0x1 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=xor 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=2 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=software 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@22 -- # accel_module=software 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=32 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=32 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=1 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val=Yes 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:05.117 14:53:45 -- accel/accel.sh@20 -- # val= 00:06:05.117 14:53:45 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # IFS=: 00:06:05.117 14:53:45 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.060 14:53:46 -- accel/accel.sh@20 -- # val= 00:06:06.060 14:53:46 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # IFS=: 00:06:06.060 14:53:46 -- accel/accel.sh@19 -- # read -r var val 00:06:06.061 14:53:46 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:06.061 14:53:46 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:06.061 14:53:46 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.061 00:06:06.061 real 0m1.288s 00:06:06.061 user 0m1.198s 00:06:06.061 sys 0m0.099s 00:06:06.061 14:53:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:06.061 14:53:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.061 ************************************ 00:06:06.061 END TEST accel_xor 00:06:06.061 ************************************ 00:06:06.061 14:53:46 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:06.061 14:53:46 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:06.061 14:53:46 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:06.061 14:53:46 -- common/autotest_common.sh@10 -- # set +x 00:06:06.321 ************************************ 00:06:06.321 START TEST accel_xor 00:06:06.321 ************************************ 00:06:06.321 14:53:47 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w xor -y -x 3 00:06:06.321 14:53:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.321 14:53:47 -- accel/accel.sh@17 -- # local accel_module 00:06:06.321 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.321 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.321 14:53:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:06.321 14:53:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:06.321 14:53:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.321 14:53:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:06.321 14:53:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:06.321 14:53:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.321 14:53:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.321 14:53:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:06.321 14:53:47 -- accel/accel.sh@40 -- # local IFS=, 00:06:06.321 14:53:47 -- accel/accel.sh@41 -- # jq -r . 00:06:06.321 [2024-04-26 14:53:47.135767] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:06.321 [2024-04-26 14:53:47.135858] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328755 ] 00:06:06.321 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.321 [2024-04-26 14:53:47.196931] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.321 [2024-04-26 14:53:47.260702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val=0x1 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.582 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.582 14:53:47 -- accel/accel.sh@20 -- # val=xor 00:06:06.582 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=3 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=software 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@22 -- # accel_module=software 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=32 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=32 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=1 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val=Yes 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:06.583 14:53:47 -- accel/accel.sh@20 -- # val= 00:06:06.583 14:53:47 -- accel/accel.sh@21 -- # case "$var" in 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # IFS=: 00:06:06.583 14:53:47 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:07.526 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.526 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.526 14:53:48 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:07.526 14:53:48 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:07.526 14:53:48 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.526 00:06:07.526 real 0m1.282s 00:06:07.526 user 0m1.195s 00:06:07.526 sys 0m0.097s 00:06:07.526 14:53:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:07.526 14:53:48 -- common/autotest_common.sh@10 -- # set +x 00:06:07.526 ************************************ 00:06:07.526 END TEST accel_xor 00:06:07.527 ************************************ 00:06:07.527 14:53:48 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:07.527 14:53:48 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:07.527 14:53:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:07.527 14:53:48 -- common/autotest_common.sh@10 -- # set +x 00:06:07.788 ************************************ 00:06:07.788 START TEST accel_dif_verify 00:06:07.788 ************************************ 00:06:07.788 14:53:48 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_verify 00:06:07.788 14:53:48 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.788 14:53:48 -- accel/accel.sh@17 -- # local accel_module 00:06:07.788 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:07.788 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:07.788 14:53:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:07.788 14:53:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:07.788 14:53:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.788 14:53:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:07.788 14:53:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:07.788 14:53:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.788 14:53:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.788 14:53:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:07.788 14:53:48 -- accel/accel.sh@40 -- # local IFS=, 00:06:07.788 14:53:48 -- accel/accel.sh@41 -- # jq -r . 00:06:07.788 [2024-04-26 14:53:48.591728] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:07.788 [2024-04-26 14:53:48.591788] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329111 ] 00:06:07.788 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.788 [2024-04-26 14:53:48.653863] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.788 [2024-04-26 14:53:48.722066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.048 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.048 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.048 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.048 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.048 14:53:48 -- accel/accel.sh@20 -- # val=0x1 00:06:08.048 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.048 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.048 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.048 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=dif_verify 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=software 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@22 -- # accel_module=software 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=32 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=32 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=1 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val=No 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.049 14:53:48 -- accel/accel.sh@20 -- # val= 00:06:08.049 14:53:48 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # IFS=: 00:06:08.049 14:53:48 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@20 -- # val= 00:06:08.991 14:53:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # IFS=: 00:06:08.991 14:53:49 -- accel/accel.sh@19 -- # read -r var val 00:06:08.991 14:53:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:08.991 14:53:49 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:06:08.991 14:53:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.991 00:06:08.991 real 0m1.289s 00:06:08.991 user 0m1.198s 00:06:08.991 sys 0m0.102s 00:06:08.991 14:53:49 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:08.991 14:53:49 -- common/autotest_common.sh@10 -- # set +x 00:06:08.991 ************************************ 00:06:08.991 END TEST accel_dif_verify 00:06:08.991 ************************************ 00:06:08.991 14:53:49 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:08.991 14:53:49 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:08.991 14:53:49 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:08.991 14:53:49 -- common/autotest_common.sh@10 -- # set +x 00:06:09.252 ************************************ 00:06:09.252 START TEST accel_dif_generate 00:06:09.252 ************************************ 00:06:09.252 14:53:50 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_generate 00:06:09.252 14:53:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.252 14:53:50 -- accel/accel.sh@17 -- # local accel_module 00:06:09.252 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.252 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.252 14:53:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:09.252 14:53:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:09.252 14:53:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.252 14:53:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:09.252 14:53:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:09.252 14:53:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.252 14:53:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.252 14:53:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:09.252 14:53:50 -- accel/accel.sh@40 -- # local IFS=, 00:06:09.252 14:53:50 -- accel/accel.sh@41 -- # jq -r . 00:06:09.252 [2024-04-26 14:53:50.064004] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:09.252 [2024-04-26 14:53:50.064074] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329473 ] 00:06:09.252 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.252 [2024-04-26 14:53:50.127687] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.252 [2024-04-26 14:53:50.195132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=0x1 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=dif_generate 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=software 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@22 -- # accel_module=software 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=32 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=32 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=1 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val=No 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:09.514 14:53:50 -- accel/accel.sh@20 -- # val= 00:06:09.514 14:53:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # IFS=: 00:06:09.514 14:53:50 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.459 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.459 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.459 14:53:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:10.459 14:53:51 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:06:10.459 14:53:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.459 00:06:10.459 real 0m1.289s 00:06:10.459 user 0m1.197s 00:06:10.459 sys 0m0.103s 00:06:10.459 14:53:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:10.459 14:53:51 -- common/autotest_common.sh@10 -- # set +x 00:06:10.459 ************************************ 00:06:10.459 END TEST accel_dif_generate 00:06:10.459 ************************************ 00:06:10.459 14:53:51 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:10.459 14:53:51 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:10.459 14:53:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:10.459 14:53:51 -- common/autotest_common.sh@10 -- # set +x 00:06:10.720 ************************************ 00:06:10.720 START TEST accel_dif_generate_copy 00:06:10.720 ************************************ 00:06:10.720 14:53:51 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_generate_copy 00:06:10.720 14:53:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.720 14:53:51 -- accel/accel.sh@17 -- # local accel_module 00:06:10.720 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.720 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.720 14:53:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:10.720 14:53:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:10.720 14:53:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.720 14:53:51 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:10.720 14:53:51 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:10.720 14:53:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.720 14:53:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.720 14:53:51 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:10.720 14:53:51 -- accel/accel.sh@40 -- # local IFS=, 00:06:10.720 14:53:51 -- accel/accel.sh@41 -- # jq -r . 00:06:10.720 [2024-04-26 14:53:51.536832] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:10.720 [2024-04-26 14:53:51.536902] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329829 ] 00:06:10.720 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.720 [2024-04-26 14:53:51.601368] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.982 [2024-04-26 14:53:51.672417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=0x1 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=software 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@22 -- # accel_module=software 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=32 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=32 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=1 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val=No 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:10.982 14:53:51 -- accel/accel.sh@20 -- # val= 00:06:10.982 14:53:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # IFS=: 00:06:10.982 14:53:51 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@20 -- # val= 00:06:11.928 14:53:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:11.928 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:11.928 14:53:52 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:11.928 14:53:52 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:06:11.928 14:53:52 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.928 00:06:11.928 real 0m1.293s 00:06:11.928 user 0m1.203s 00:06:11.928 sys 0m0.100s 00:06:11.928 14:53:52 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:11.928 14:53:52 -- common/autotest_common.sh@10 -- # set +x 00:06:11.928 ************************************ 00:06:11.928 END TEST accel_dif_generate_copy 00:06:11.928 ************************************ 00:06:11.928 14:53:52 -- accel/accel.sh@115 -- # [[ y == y ]] 00:06:11.928 14:53:52 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:11.928 14:53:52 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:06:11.928 14:53:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:11.928 14:53:52 -- common/autotest_common.sh@10 -- # set +x 00:06:12.190 ************************************ 00:06:12.190 START TEST accel_comp 00:06:12.190 ************************************ 00:06:12.190 14:53:52 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:12.190 14:53:52 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.190 14:53:52 -- accel/accel.sh@17 -- # local accel_module 00:06:12.190 14:53:52 -- accel/accel.sh@19 -- # IFS=: 00:06:12.190 14:53:52 -- accel/accel.sh@19 -- # read -r var val 00:06:12.190 14:53:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:12.190 14:53:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:12.190 14:53:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.190 14:53:52 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:12.190 14:53:52 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:12.190 14:53:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.190 14:53:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.190 14:53:52 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:12.190 14:53:52 -- accel/accel.sh@40 -- # local IFS=, 00:06:12.190 14:53:52 -- accel/accel.sh@41 -- # jq -r . 00:06:12.190 [2024-04-26 14:53:53.016397] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:12.190 [2024-04-26 14:53:53.016467] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330136 ] 00:06:12.190 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.190 [2024-04-26 14:53:53.081101] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.452 [2024-04-26 14:53:53.152992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=0x1 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=compress 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@23 -- # accel_opc=compress 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=software 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@22 -- # accel_module=software 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=32 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=32 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=1 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val=No 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:12.452 14:53:53 -- accel/accel.sh@20 -- # val= 00:06:12.452 14:53:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # IFS=: 00:06:12.452 14:53:53 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.394 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.394 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.394 14:53:54 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:13.394 14:53:54 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:06:13.394 14:53:54 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.394 00:06:13.394 real 0m1.298s 00:06:13.394 user 0m1.197s 00:06:13.394 sys 0m0.112s 00:06:13.394 14:53:54 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:13.394 14:53:54 -- common/autotest_common.sh@10 -- # set +x 00:06:13.394 ************************************ 00:06:13.394 END TEST accel_comp 00:06:13.394 ************************************ 00:06:13.394 14:53:54 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:13.394 14:53:54 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:13.394 14:53:54 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:13.394 14:53:54 -- common/autotest_common.sh@10 -- # set +x 00:06:13.655 ************************************ 00:06:13.655 START TEST accel_decomp 00:06:13.655 ************************************ 00:06:13.655 14:53:54 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:13.655 14:53:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.655 14:53:54 -- accel/accel.sh@17 -- # local accel_module 00:06:13.655 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.655 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.655 14:53:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:13.655 14:53:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:13.655 14:53:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.655 14:53:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:13.655 14:53:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:13.655 14:53:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.655 14:53:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.655 14:53:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:13.655 14:53:54 -- accel/accel.sh@40 -- # local IFS=, 00:06:13.655 14:53:54 -- accel/accel.sh@41 -- # jq -r . 00:06:13.655 [2024-04-26 14:53:54.501750] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:13.655 [2024-04-26 14:53:54.501815] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330373 ] 00:06:13.655 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.655 [2024-04-26 14:53:54.567235] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.917 [2024-04-26 14:53:54.642376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=0x1 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=decompress 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=software 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@22 -- # accel_module=software 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=32 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=32 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=1 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val=Yes 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:13.917 14:53:54 -- accel/accel.sh@20 -- # val= 00:06:13.917 14:53:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # IFS=: 00:06:13.917 14:53:54 -- accel/accel.sh@19 -- # read -r var val 00:06:14.860 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.860 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.860 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.860 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.860 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.860 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.860 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.860 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.860 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.860 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.860 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.861 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.861 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.861 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.861 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.861 14:53:55 -- accel/accel.sh@20 -- # val= 00:06:14.861 14:53:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:14.861 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:14.861 14:53:55 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:14.861 14:53:55 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:14.861 14:53:55 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.861 00:06:14.861 real 0m1.300s 00:06:14.861 user 0m1.202s 00:06:14.861 sys 0m0.110s 00:06:14.861 14:53:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:14.861 14:53:55 -- common/autotest_common.sh@10 -- # set +x 00:06:14.861 ************************************ 00:06:14.861 END TEST accel_decomp 00:06:14.861 ************************************ 00:06:15.123 14:53:55 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.123 14:53:55 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:06:15.123 14:53:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:15.123 14:53:55 -- common/autotest_common.sh@10 -- # set +x 00:06:15.123 ************************************ 00:06:15.123 START TEST accel_decmop_full 00:06:15.123 ************************************ 00:06:15.123 14:53:55 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.123 14:53:55 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.123 14:53:55 -- accel/accel.sh@17 -- # local accel_module 00:06:15.123 14:53:55 -- accel/accel.sh@19 -- # IFS=: 00:06:15.123 14:53:55 -- accel/accel.sh@19 -- # read -r var val 00:06:15.123 14:53:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.123 14:53:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.123 14:53:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.123 14:53:55 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:15.123 14:53:55 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:15.123 14:53:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.123 14:53:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.123 14:53:55 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:15.123 14:53:55 -- accel/accel.sh@40 -- # local IFS=, 00:06:15.123 14:53:55 -- accel/accel.sh@41 -- # jq -r . 00:06:15.123 [2024-04-26 14:53:55.987420] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:15.123 [2024-04-26 14:53:55.987501] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330620 ] 00:06:15.123 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.123 [2024-04-26 14:53:56.052660] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.385 [2024-04-26 14:53:56.124802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=0x1 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=decompress 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=software 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@22 -- # accel_module=software 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=32 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=32 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=1 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val=Yes 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:15.385 14:53:56 -- accel/accel.sh@20 -- # val= 00:06:15.385 14:53:56 -- accel/accel.sh@21 -- # case "$var" in 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # IFS=: 00:06:15.385 14:53:56 -- accel/accel.sh@19 -- # read -r var val 00:06:16.329 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.329 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.329 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.329 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.330 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.330 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.330 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.330 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.330 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.330 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.330 14:53:57 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:16.330 14:53:57 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:16.330 14:53:57 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.330 00:06:16.330 real 0m1.305s 00:06:16.330 user 0m1.206s 00:06:16.330 sys 0m0.111s 00:06:16.330 14:53:57 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:16.330 14:53:57 -- common/autotest_common.sh@10 -- # set +x 00:06:16.330 ************************************ 00:06:16.330 END TEST accel_decmop_full 00:06:16.330 ************************************ 00:06:16.592 14:53:57 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.592 14:53:57 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:06:16.592 14:53:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:16.592 14:53:57 -- common/autotest_common.sh@10 -- # set +x 00:06:16.592 ************************************ 00:06:16.592 START TEST accel_decomp_mcore 00:06:16.592 ************************************ 00:06:16.592 14:53:57 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.592 14:53:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.592 14:53:57 -- accel/accel.sh@17 -- # local accel_module 00:06:16.592 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.592 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.592 14:53:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.592 14:53:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.592 14:53:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.592 14:53:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:16.592 14:53:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:16.592 14:53:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.592 14:53:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.592 14:53:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:16.592 14:53:57 -- accel/accel.sh@40 -- # local IFS=, 00:06:16.592 14:53:57 -- accel/accel.sh@41 -- # jq -r . 00:06:16.592 [2024-04-26 14:53:57.475370] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:16.592 [2024-04-26 14:53:57.475447] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330949 ] 00:06:16.592 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.592 [2024-04-26 14:53:57.541025] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:16.855 [2024-04-26 14:53:57.616501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.855 [2024-04-26 14:53:57.616638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.855 [2024-04-26 14:53:57.616762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:16.855 [2024-04-26 14:53:57.616765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.855 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.855 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.855 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.855 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.855 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.855 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.855 14:53:57 -- accel/accel.sh@20 -- # val=0xf 00:06:16.855 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.855 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.855 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=decompress 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=software 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@22 -- # accel_module=software 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=32 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=32 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=1 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val=Yes 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:16.856 14:53:57 -- accel/accel.sh@20 -- # val= 00:06:16.856 14:53:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # IFS=: 00:06:16.856 14:53:57 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:18.242 14:53:58 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:18.242 14:53:58 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.242 00:06:18.242 real 0m1.308s 00:06:18.242 user 0m4.447s 00:06:18.242 sys 0m0.108s 00:06:18.242 14:53:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:18.242 14:53:58 -- common/autotest_common.sh@10 -- # set +x 00:06:18.242 ************************************ 00:06:18.242 END TEST accel_decomp_mcore 00:06:18.242 ************************************ 00:06:18.242 14:53:58 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.242 14:53:58 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:06:18.242 14:53:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:18.242 14:53:58 -- common/autotest_common.sh@10 -- # set +x 00:06:18.242 ************************************ 00:06:18.242 START TEST accel_decomp_full_mcore 00:06:18.242 ************************************ 00:06:18.242 14:53:58 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.242 14:53:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.242 14:53:58 -- accel/accel.sh@17 -- # local accel_module 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:58 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.242 14:53:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.242 14:53:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.242 14:53:58 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:18.242 14:53:58 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:18.242 14:53:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.242 14:53:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.242 14:53:58 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:18.242 14:53:58 -- accel/accel.sh@40 -- # local IFS=, 00:06:18.242 14:53:58 -- accel/accel.sh@41 -- # jq -r . 00:06:18.242 [2024-04-26 14:53:58.965105] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:18.242 [2024-04-26 14:53:58.965169] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331315 ] 00:06:18.242 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.242 [2024-04-26 14:53:59.029039] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.242 [2024-04-26 14:53:59.102773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.242 [2024-04-26 14:53:59.102915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.242 [2024-04-26 14:53:59.103042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.242 [2024-04-26 14:53:59.103045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=0xf 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=decompress 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=software 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@22 -- # accel_module=software 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=32 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=32 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=1 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val=Yes 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:18.242 14:53:59 -- accel/accel.sh@20 -- # val= 00:06:18.242 14:53:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # IFS=: 00:06:18.242 14:53:59 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.628 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.628 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.628 14:54:00 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:19.628 14:54:00 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:19.628 14:54:00 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.628 00:06:19.628 real 0m1.318s 00:06:19.628 user 0m4.488s 00:06:19.628 sys 0m0.116s 00:06:19.628 14:54:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:19.628 14:54:00 -- common/autotest_common.sh@10 -- # set +x 00:06:19.628 ************************************ 00:06:19.628 END TEST accel_decomp_full_mcore 00:06:19.628 ************************************ 00:06:19.628 14:54:00 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.628 14:54:00 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:06:19.628 14:54:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:19.628 14:54:00 -- common/autotest_common.sh@10 -- # set +x 00:06:19.628 ************************************ 00:06:19.628 START TEST accel_decomp_mthread 00:06:19.628 ************************************ 00:06:19.628 14:54:00 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.628 14:54:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.628 14:54:00 -- accel/accel.sh@17 -- # local accel_module 00:06:19.629 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.629 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.629 14:54:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.629 14:54:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:19.629 14:54:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.629 14:54:00 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:19.629 14:54:00 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:19.629 14:54:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.629 14:54:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.629 14:54:00 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:19.629 14:54:00 -- accel/accel.sh@40 -- # local IFS=, 00:06:19.629 14:54:00 -- accel/accel.sh@41 -- # jq -r . 00:06:19.629 [2024-04-26 14:54:00.462275] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:19.629 [2024-04-26 14:54:00.462362] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331697 ] 00:06:19.629 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.629 [2024-04-26 14:54:00.526799] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.889 [2024-04-26 14:54:00.599868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=0x1 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=decompress 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=software 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@22 -- # accel_module=software 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=32 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=32 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=2 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val=Yes 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:19.889 14:54:00 -- accel/accel.sh@20 -- # val= 00:06:19.889 14:54:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # IFS=: 00:06:19.889 14:54:00 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@20 -- # val= 00:06:20.830 14:54:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:20.830 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:20.830 14:54:01 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:20.830 14:54:01 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:20.830 14:54:01 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:20.830 00:06:20.830 real 0m1.299s 00:06:20.830 user 0m1.207s 00:06:20.830 sys 0m0.102s 00:06:20.830 14:54:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:20.830 14:54:01 -- common/autotest_common.sh@10 -- # set +x 00:06:20.830 ************************************ 00:06:20.830 END TEST accel_decomp_mthread 00:06:20.830 ************************************ 00:06:20.830 14:54:01 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:20.830 14:54:01 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:06:20.830 14:54:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:20.830 14:54:01 -- common/autotest_common.sh@10 -- # set +x 00:06:21.091 ************************************ 00:06:21.091 START TEST accel_deomp_full_mthread 00:06:21.091 ************************************ 00:06:21.091 14:54:01 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.091 14:54:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.091 14:54:01 -- accel/accel.sh@17 -- # local accel_module 00:06:21.091 14:54:01 -- accel/accel.sh@19 -- # IFS=: 00:06:21.091 14:54:01 -- accel/accel.sh@19 -- # read -r var val 00:06:21.091 14:54:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.091 14:54:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.091 14:54:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.091 14:54:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:21.091 14:54:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:21.091 14:54:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.091 14:54:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.091 14:54:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:21.091 14:54:01 -- accel/accel.sh@40 -- # local IFS=, 00:06:21.091 14:54:01 -- accel/accel.sh@41 -- # jq -r . 00:06:21.091 [2024-04-26 14:54:01.940112] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:21.091 [2024-04-26 14:54:01.940174] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332140 ] 00:06:21.091 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.091 [2024-04-26 14:54:02.003329] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.352 [2024-04-26 14:54:02.075297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=0x1 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=decompress 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=software 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@22 -- # accel_module=software 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=32 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=32 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=2 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val=Yes 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:21.352 14:54:02 -- accel/accel.sh@20 -- # val= 00:06:21.352 14:54:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # IFS=: 00:06:21.352 14:54:02 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@20 -- # val= 00:06:22.297 14:54:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # IFS=: 00:06:22.297 14:54:03 -- accel/accel.sh@19 -- # read -r var val 00:06:22.297 14:54:03 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:22.297 14:54:03 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:22.297 14:54:03 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.297 00:06:22.297 real 0m1.324s 00:06:22.297 user 0m1.240s 00:06:22.297 sys 0m0.096s 00:06:22.297 14:54:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:22.297 14:54:03 -- common/autotest_common.sh@10 -- # set +x 00:06:22.297 ************************************ 00:06:22.297 END TEST accel_deomp_full_mthread 00:06:22.297 ************************************ 00:06:22.557 14:54:03 -- accel/accel.sh@124 -- # [[ n == y ]] 00:06:22.557 14:54:03 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.557 14:54:03 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:06:22.557 14:54:03 -- accel/accel.sh@137 -- # build_accel_config 00:06:22.557 14:54:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:22.557 14:54:03 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:22.557 14:54:03 -- common/autotest_common.sh@10 -- # set +x 00:06:22.557 14:54:03 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:22.557 14:54:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.557 14:54:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.557 14:54:03 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:22.557 14:54:03 -- accel/accel.sh@40 -- # local IFS=, 00:06:22.557 14:54:03 -- accel/accel.sh@41 -- # jq -r . 00:06:22.557 ************************************ 00:06:22.557 START TEST accel_dif_functional_tests 00:06:22.557 ************************************ 00:06:22.557 14:54:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:22.557 [2024-04-26 14:54:03.472166] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:22.557 [2024-04-26 14:54:03.472225] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332501 ] 00:06:22.557 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.818 [2024-04-26 14:54:03.535486] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:22.818 [2024-04-26 14:54:03.608760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.818 [2024-04-26 14:54:03.608897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:22.818 [2024-04-26 14:54:03.608901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.818 00:06:22.818 00:06:22.818 CUnit - A unit testing framework for C - Version 2.1-3 00:06:22.818 http://cunit.sourceforge.net/ 00:06:22.818 00:06:22.818 00:06:22.818 Suite: accel_dif 00:06:22.818 Test: verify: DIF generated, GUARD check ...passed 00:06:22.818 Test: verify: DIF generated, APPTAG check ...passed 00:06:22.818 Test: verify: DIF generated, REFTAG check ...passed 00:06:22.818 Test: verify: DIF not generated, GUARD check ...[2024-04-26 14:54:03.664967] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:22.818 [2024-04-26 14:54:03.665006] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:22.818 passed 00:06:22.818 Test: verify: DIF not generated, APPTAG check ...[2024-04-26 14:54:03.665034] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:22.818 [2024-04-26 14:54:03.665048] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:22.818 passed 00:06:22.818 Test: verify: DIF not generated, REFTAG check ...[2024-04-26 14:54:03.665064] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:22.818 [2024-04-26 14:54:03.665079] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:22.818 passed 00:06:22.818 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:22.818 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-26 14:54:03.665120] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:22.818 passed 00:06:22.818 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:22.818 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:22.818 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:22.818 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-26 14:54:03.665232] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:22.818 passed 00:06:22.818 Test: generate copy: DIF generated, GUARD check ...passed 00:06:22.818 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:22.818 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:22.818 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:22.818 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:22.818 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:22.818 Test: generate copy: iovecs-len validate ...[2024-04-26 14:54:03.665421] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:22.818 passed 00:06:22.818 Test: generate copy: buffer alignment validate ...passed 00:06:22.818 00:06:22.818 Run Summary: Type Total Ran Passed Failed Inactive 00:06:22.818 suites 1 1 n/a 0 0 00:06:22.818 tests 20 20 20 0 0 00:06:22.818 asserts 204 204 204 0 n/a 00:06:22.818 00:06:22.818 Elapsed time = 0.002 seconds 00:06:23.079 00:06:23.079 real 0m0.356s 00:06:23.079 user 0m0.453s 00:06:23.079 sys 0m0.123s 00:06:23.079 14:54:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:23.079 14:54:03 -- common/autotest_common.sh@10 -- # set +x 00:06:23.079 ************************************ 00:06:23.079 END TEST accel_dif_functional_tests 00:06:23.079 ************************************ 00:06:23.079 00:06:23.079 real 0m32.807s 00:06:23.079 user 0m34.798s 00:06:23.079 sys 0m5.284s 00:06:23.079 14:54:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:23.079 14:54:03 -- common/autotest_common.sh@10 -- # set +x 00:06:23.079 ************************************ 00:06:23.079 END TEST accel 00:06:23.079 ************************************ 00:06:23.079 14:54:03 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.079 14:54:03 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:23.079 14:54:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:23.079 14:54:03 -- common/autotest_common.sh@10 -- # set +x 00:06:23.079 ************************************ 00:06:23.079 START TEST accel_rpc 00:06:23.079 ************************************ 00:06:23.079 14:54:04 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.340 * Looking for test storage... 00:06:23.340 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:06:23.340 14:54:04 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:23.340 14:54:04 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3332579 00:06:23.340 14:54:04 -- accel/accel_rpc.sh@15 -- # waitforlisten 3332579 00:06:23.340 14:54:04 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:23.340 14:54:04 -- common/autotest_common.sh@827 -- # '[' -z 3332579 ']' 00:06:23.340 14:54:04 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.340 14:54:04 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:23.340 14:54:04 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.340 14:54:04 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:23.340 14:54:04 -- common/autotest_common.sh@10 -- # set +x 00:06:23.340 [2024-04-26 14:54:04.168039] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:23.340 [2024-04-26 14:54:04.168103] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332579 ] 00:06:23.340 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.340 [2024-04-26 14:54:04.232154] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.669 [2024-04-26 14:54:04.305520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.240 14:54:04 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:24.240 14:54:04 -- common/autotest_common.sh@860 -- # return 0 00:06:24.240 14:54:04 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:24.240 14:54:04 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:24.240 14:54:04 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:24.240 14:54:04 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:24.240 14:54:04 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:24.240 14:54:04 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:24.240 14:54:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:24.240 14:54:04 -- common/autotest_common.sh@10 -- # set +x 00:06:24.240 ************************************ 00:06:24.240 START TEST accel_assign_opcode 00:06:24.240 ************************************ 00:06:24.240 14:54:05 -- common/autotest_common.sh@1121 -- # accel_assign_opcode_test_suite 00:06:24.241 14:54:05 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:24.241 14:54:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:24.241 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.241 [2024-04-26 14:54:05.091761] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:24.241 14:54:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:24.241 14:54:05 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:24.241 14:54:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:24.241 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.241 [2024-04-26 14:54:05.103786] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:24.241 14:54:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:24.241 14:54:05 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:24.241 14:54:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:24.241 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.500 14:54:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:24.500 14:54:05 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:24.500 14:54:05 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:24.500 14:54:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:24.500 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.500 14:54:05 -- accel/accel_rpc.sh@42 -- # grep software 00:06:24.500 14:54:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:24.500 software 00:06:24.500 00:06:24.500 real 0m0.213s 00:06:24.500 user 0m0.047s 00:06:24.500 sys 0m0.012s 00:06:24.500 14:54:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:24.500 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.500 ************************************ 00:06:24.500 END TEST accel_assign_opcode 00:06:24.500 ************************************ 00:06:24.500 14:54:05 -- accel/accel_rpc.sh@55 -- # killprocess 3332579 00:06:24.500 14:54:05 -- common/autotest_common.sh@946 -- # '[' -z 3332579 ']' 00:06:24.500 14:54:05 -- common/autotest_common.sh@950 -- # kill -0 3332579 00:06:24.500 14:54:05 -- common/autotest_common.sh@951 -- # uname 00:06:24.500 14:54:05 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:24.500 14:54:05 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3332579 00:06:24.500 14:54:05 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:24.500 14:54:05 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:24.500 14:54:05 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3332579' 00:06:24.500 killing process with pid 3332579 00:06:24.500 14:54:05 -- common/autotest_common.sh@965 -- # kill 3332579 00:06:24.500 14:54:05 -- common/autotest_common.sh@970 -- # wait 3332579 00:06:24.760 00:06:24.760 real 0m1.592s 00:06:24.760 user 0m1.710s 00:06:24.760 sys 0m0.468s 00:06:24.760 14:54:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:24.760 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:24.760 ************************************ 00:06:24.760 END TEST accel_rpc 00:06:24.760 ************************************ 00:06:24.760 14:54:05 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:06:24.760 14:54:05 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:24.760 14:54:05 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:24.760 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:25.034 ************************************ 00:06:25.034 START TEST app_cmdline 00:06:25.034 ************************************ 00:06:25.034 14:54:05 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:06:25.034 * Looking for test storage... 00:06:25.034 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:25.034 14:54:05 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:25.034 14:54:05 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3332998 00:06:25.034 14:54:05 -- app/cmdline.sh@18 -- # waitforlisten 3332998 00:06:25.034 14:54:05 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:25.034 14:54:05 -- common/autotest_common.sh@827 -- # '[' -z 3332998 ']' 00:06:25.034 14:54:05 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.034 14:54:05 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:25.034 14:54:05 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.034 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.034 14:54:05 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:25.034 14:54:05 -- common/autotest_common.sh@10 -- # set +x 00:06:25.034 [2024-04-26 14:54:05.934562] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:25.034 [2024-04-26 14:54:05.934621] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332998 ] 00:06:25.034 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.314 [2024-04-26 14:54:06.000955] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.314 [2024-04-26 14:54:06.076302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.893 14:54:06 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:25.893 14:54:06 -- common/autotest_common.sh@860 -- # return 0 00:06:25.893 14:54:06 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:26.154 { 00:06:26.154 "version": "SPDK v24.05-pre git sha1 52d0b12f9", 00:06:26.154 "fields": { 00:06:26.154 "major": 24, 00:06:26.154 "minor": 5, 00:06:26.154 "patch": 0, 00:06:26.154 "suffix": "-pre", 00:06:26.154 "commit": "52d0b12f9" 00:06:26.154 } 00:06:26.154 } 00:06:26.154 14:54:06 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:26.154 14:54:06 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:26.154 14:54:06 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:26.154 14:54:06 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:26.154 14:54:06 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:26.154 14:54:06 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:26.154 14:54:06 -- app/cmdline.sh@26 -- # sort 00:06:26.154 14:54:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:26.154 14:54:06 -- common/autotest_common.sh@10 -- # set +x 00:06:26.154 14:54:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:26.154 14:54:06 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:26.154 14:54:06 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:26.154 14:54:06 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.154 14:54:06 -- common/autotest_common.sh@648 -- # local es=0 00:06:26.154 14:54:06 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.154 14:54:06 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:26.154 14:54:06 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:26.154 14:54:06 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:26.154 14:54:06 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:26.154 14:54:06 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:26.154 14:54:06 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:26.154 14:54:06 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:26.154 14:54:06 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:06:26.154 14:54:06 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.154 request: 00:06:26.154 { 00:06:26.154 "method": "env_dpdk_get_mem_stats", 00:06:26.154 "req_id": 1 00:06:26.154 } 00:06:26.154 Got JSON-RPC error response 00:06:26.154 response: 00:06:26.154 { 00:06:26.154 "code": -32601, 00:06:26.155 "message": "Method not found" 00:06:26.155 } 00:06:26.155 14:54:07 -- common/autotest_common.sh@651 -- # es=1 00:06:26.155 14:54:07 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:26.155 14:54:07 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:26.155 14:54:07 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:26.155 14:54:07 -- app/cmdline.sh@1 -- # killprocess 3332998 00:06:26.155 14:54:07 -- common/autotest_common.sh@946 -- # '[' -z 3332998 ']' 00:06:26.155 14:54:07 -- common/autotest_common.sh@950 -- # kill -0 3332998 00:06:26.155 14:54:07 -- common/autotest_common.sh@951 -- # uname 00:06:26.155 14:54:07 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:26.155 14:54:07 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3332998 00:06:26.415 14:54:07 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:26.415 14:54:07 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:26.415 14:54:07 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3332998' 00:06:26.415 killing process with pid 3332998 00:06:26.415 14:54:07 -- common/autotest_common.sh@965 -- # kill 3332998 00:06:26.415 14:54:07 -- common/autotest_common.sh@970 -- # wait 3332998 00:06:26.415 00:06:26.415 real 0m1.544s 00:06:26.415 user 0m1.819s 00:06:26.415 sys 0m0.416s 00:06:26.415 14:54:07 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:26.415 14:54:07 -- common/autotest_common.sh@10 -- # set +x 00:06:26.415 ************************************ 00:06:26.415 END TEST app_cmdline 00:06:26.415 ************************************ 00:06:26.415 14:54:07 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:06:26.415 14:54:07 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:26.415 14:54:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:26.415 14:54:07 -- common/autotest_common.sh@10 -- # set +x 00:06:26.676 ************************************ 00:06:26.676 START TEST version 00:06:26.676 ************************************ 00:06:26.676 14:54:07 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:06:26.676 * Looking for test storage... 00:06:26.676 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:26.676 14:54:07 -- app/version.sh@17 -- # get_header_version major 00:06:26.677 14:54:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:26.677 14:54:07 -- app/version.sh@14 -- # cut -f2 00:06:26.677 14:54:07 -- app/version.sh@14 -- # tr -d '"' 00:06:26.677 14:54:07 -- app/version.sh@17 -- # major=24 00:06:26.677 14:54:07 -- app/version.sh@18 -- # get_header_version minor 00:06:26.677 14:54:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:26.677 14:54:07 -- app/version.sh@14 -- # cut -f2 00:06:26.677 14:54:07 -- app/version.sh@14 -- # tr -d '"' 00:06:26.677 14:54:07 -- app/version.sh@18 -- # minor=5 00:06:26.677 14:54:07 -- app/version.sh@19 -- # get_header_version patch 00:06:26.677 14:54:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:26.677 14:54:07 -- app/version.sh@14 -- # cut -f2 00:06:26.677 14:54:07 -- app/version.sh@14 -- # tr -d '"' 00:06:26.677 14:54:07 -- app/version.sh@19 -- # patch=0 00:06:26.677 14:54:07 -- app/version.sh@20 -- # get_header_version suffix 00:06:26.677 14:54:07 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:26.677 14:54:07 -- app/version.sh@14 -- # cut -f2 00:06:26.677 14:54:07 -- app/version.sh@14 -- # tr -d '"' 00:06:26.938 14:54:07 -- app/version.sh@20 -- # suffix=-pre 00:06:26.938 14:54:07 -- app/version.sh@22 -- # version=24.5 00:06:26.938 14:54:07 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:26.939 14:54:07 -- app/version.sh@28 -- # version=24.5rc0 00:06:26.939 14:54:07 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:26.939 14:54:07 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:26.939 14:54:07 -- app/version.sh@30 -- # py_version=24.5rc0 00:06:26.939 14:54:07 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:06:26.939 00:06:26.939 real 0m0.187s 00:06:26.939 user 0m0.095s 00:06:26.939 sys 0m0.134s 00:06:26.939 14:54:07 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:26.939 14:54:07 -- common/autotest_common.sh@10 -- # set +x 00:06:26.939 ************************************ 00:06:26.939 END TEST version 00:06:26.939 ************************************ 00:06:26.939 14:54:07 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@194 -- # uname -s 00:06:26.939 14:54:07 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:06:26.939 14:54:07 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:26.939 14:54:07 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:26.939 14:54:07 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@258 -- # timing_exit lib 00:06:26.939 14:54:07 -- common/autotest_common.sh@726 -- # xtrace_disable 00:06:26.939 14:54:07 -- common/autotest_common.sh@10 -- # set +x 00:06:26.939 14:54:07 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:06:26.939 14:54:07 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:06:26.939 14:54:07 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:26.939 14:54:07 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:06:26.939 14:54:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:26.939 14:54:07 -- common/autotest_common.sh@10 -- # set +x 00:06:27.201 ************************************ 00:06:27.201 START TEST nvmf_rdma 00:06:27.201 ************************************ 00:06:27.201 14:54:07 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:27.201 * Looking for test storage... 00:06:27.201 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:06:27.201 14:54:08 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:27.201 14:54:08 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:27.201 14:54:08 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.201 14:54:08 -- nvmf/common.sh@7 -- # uname -s 00:06:27.201 14:54:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.201 14:54:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.201 14:54:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.201 14:54:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.201 14:54:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.201 14:54:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.201 14:54:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.201 14:54:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.201 14:54:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.201 14:54:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.201 14:54:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:27.201 14:54:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:27.201 14:54:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.201 14:54:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.201 14:54:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.201 14:54:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:27.201 14:54:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:27.201 14:54:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.201 14:54:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.201 14:54:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.201 14:54:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.201 14:54:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.201 14:54:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.201 14:54:08 -- paths/export.sh@5 -- # export PATH 00:06:27.202 14:54:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.202 14:54:08 -- nvmf/common.sh@47 -- # : 0 00:06:27.202 14:54:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:27.202 14:54:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:27.202 14:54:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:27.202 14:54:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.202 14:54:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.202 14:54:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:27.202 14:54:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:27.202 14:54:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:27.202 14:54:08 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:27.202 14:54:08 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:27.202 14:54:08 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:27.202 14:54:08 -- common/autotest_common.sh@720 -- # xtrace_disable 00:06:27.202 14:54:08 -- common/autotest_common.sh@10 -- # set +x 00:06:27.202 14:54:08 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:27.202 14:54:08 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:27.202 14:54:08 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:06:27.202 14:54:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:27.202 14:54:08 -- common/autotest_common.sh@10 -- # set +x 00:06:27.463 ************************************ 00:06:27.463 START TEST nvmf_example 00:06:27.464 ************************************ 00:06:27.464 14:54:08 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:27.464 * Looking for test storage... 00:06:27.464 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:27.464 14:54:08 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.464 14:54:08 -- nvmf/common.sh@7 -- # uname -s 00:06:27.464 14:54:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.464 14:54:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.464 14:54:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.464 14:54:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.464 14:54:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.464 14:54:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.464 14:54:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.464 14:54:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.464 14:54:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.464 14:54:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.464 14:54:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:27.464 14:54:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:27.464 14:54:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.464 14:54:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.464 14:54:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.464 14:54:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:27.464 14:54:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:27.464 14:54:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.464 14:54:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.464 14:54:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.464 14:54:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.464 14:54:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.464 14:54:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.464 14:54:08 -- paths/export.sh@5 -- # export PATH 00:06:27.464 14:54:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.464 14:54:08 -- nvmf/common.sh@47 -- # : 0 00:06:27.464 14:54:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:27.464 14:54:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:27.464 14:54:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:27.464 14:54:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.464 14:54:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.464 14:54:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:27.464 14:54:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:27.464 14:54:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:27.464 14:54:08 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:27.464 14:54:08 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:27.464 14:54:08 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:27.464 14:54:08 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:27.464 14:54:08 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:27.464 14:54:08 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:27.464 14:54:08 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:27.464 14:54:08 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:27.464 14:54:08 -- common/autotest_common.sh@720 -- # xtrace_disable 00:06:27.464 14:54:08 -- common/autotest_common.sh@10 -- # set +x 00:06:27.464 14:54:08 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:27.464 14:54:08 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:27.464 14:54:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:27.464 14:54:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:27.464 14:54:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:27.464 14:54:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:27.464 14:54:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:27.464 14:54:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:27.464 14:54:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:27.464 14:54:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:27.464 14:54:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:27.464 14:54:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:27.464 14:54:08 -- common/autotest_common.sh@10 -- # set +x 00:06:35.612 14:54:15 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:35.612 14:54:15 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:35.612 14:54:15 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:35.612 14:54:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:35.612 14:54:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:35.612 14:54:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:35.612 14:54:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:35.612 14:54:15 -- nvmf/common.sh@295 -- # net_devs=() 00:06:35.612 14:54:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:35.612 14:54:15 -- nvmf/common.sh@296 -- # e810=() 00:06:35.612 14:54:15 -- nvmf/common.sh@296 -- # local -ga e810 00:06:35.612 14:54:15 -- nvmf/common.sh@297 -- # x722=() 00:06:35.612 14:54:15 -- nvmf/common.sh@297 -- # local -ga x722 00:06:35.612 14:54:15 -- nvmf/common.sh@298 -- # mlx=() 00:06:35.612 14:54:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:35.612 14:54:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:35.612 14:54:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:06:35.612 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:06:35.612 14:54:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:35.612 14:54:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:06:35.612 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:06:35.612 14:54:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:35.612 14:54:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.612 14:54:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.612 14:54:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:06:35.612 Found net devices under 0000:31:00.0: mlx_0_0 00:06:35.612 14:54:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.612 14:54:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.612 14:54:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:06:35.612 Found net devices under 0000:31:00.1: mlx_0_1 00:06:35.612 14:54:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.612 14:54:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:35.612 14:54:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:35.612 14:54:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:35.612 14:54:15 -- nvmf/common.sh@58 -- # uname 00:06:35.612 14:54:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:35.612 14:54:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:35.612 14:54:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:35.612 14:54:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:35.612 14:54:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:35.612 14:54:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:35.612 14:54:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:35.612 14:54:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:35.612 14:54:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:35.612 14:54:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:35.612 14:54:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:35.612 14:54:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:35.612 14:54:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:35.612 14:54:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:35.612 14:54:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:35.612 14:54:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:35.612 14:54:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:35.612 14:54:15 -- nvmf/common.sh@105 -- # continue 2 00:06:35.612 14:54:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.612 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:35.612 14:54:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@105 -- # continue 2 00:06:35.613 14:54:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:35.613 14:54:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:35.613 14:54:15 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:35.613 14:54:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:35.613 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:35.613 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:06:35.613 altname enp49s0f0np0 00:06:35.613 altname ens786f0np0 00:06:35.613 inet 192.168.100.8/24 scope global mlx_0_0 00:06:35.613 valid_lft forever preferred_lft forever 00:06:35.613 14:54:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:35.613 14:54:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:35.613 14:54:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:35.613 14:54:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:35.613 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:35.613 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:06:35.613 altname enp49s0f1np1 00:06:35.613 altname ens786f1np1 00:06:35.613 inet 192.168.100.9/24 scope global mlx_0_1 00:06:35.613 valid_lft forever preferred_lft forever 00:06:35.613 14:54:15 -- nvmf/common.sh@411 -- # return 0 00:06:35.613 14:54:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:35.613 14:54:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:35.613 14:54:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:35.613 14:54:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:35.613 14:54:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:35.613 14:54:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:35.613 14:54:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:35.613 14:54:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:35.613 14:54:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:35.613 14:54:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:35.613 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.613 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@105 -- # continue 2 00:06:35.613 14:54:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:35.613 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.613 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:35.613 14:54:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:35.613 14:54:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@105 -- # continue 2 00:06:35.613 14:54:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:35.613 14:54:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:35.613 14:54:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:35.613 14:54:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:35.613 14:54:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:35.613 14:54:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:35.613 192.168.100.9' 00:06:35.613 14:54:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:35.613 192.168.100.9' 00:06:35.613 14:54:15 -- nvmf/common.sh@446 -- # head -n 1 00:06:35.613 14:54:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:35.613 14:54:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:35.613 192.168.100.9' 00:06:35.613 14:54:15 -- nvmf/common.sh@447 -- # tail -n +2 00:06:35.613 14:54:15 -- nvmf/common.sh@447 -- # head -n 1 00:06:35.613 14:54:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:35.613 14:54:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:35.613 14:54:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:35.613 14:54:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:35.613 14:54:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:35.613 14:54:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:35.613 14:54:15 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:35.613 14:54:15 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:35.613 14:54:15 -- common/autotest_common.sh@720 -- # xtrace_disable 00:06:35.613 14:54:15 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:15 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:06:35.613 14:54:15 -- target/nvmf_example.sh@34 -- # nvmfpid=3337886 00:06:35.613 14:54:15 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:35.613 14:54:15 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:35.613 14:54:15 -- target/nvmf_example.sh@36 -- # waitforlisten 3337886 00:06:35.613 14:54:15 -- common/autotest_common.sh@827 -- # '[' -z 3337886 ']' 00:06:35.613 14:54:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:35.613 14:54:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:35.613 14:54:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:35.613 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:35.613 14:54:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:35.613 14:54:15 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.613 14:54:16 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:35.613 14:54:16 -- common/autotest_common.sh@860 -- # return 0 00:06:35.613 14:54:16 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:35.613 14:54:16 -- common/autotest_common.sh@726 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:06:35.613 14:54:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:35.613 14:54:16 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:35.613 14:54:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:35.613 14:54:16 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:35.613 14:54:16 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:35.613 14:54:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:35.613 14:54:16 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:35.613 14:54:16 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:35.613 14:54:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:35.613 14:54:16 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:35.613 14:54:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:35.613 14:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:35.613 14:54:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:35.613 14:54:16 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:35.613 14:54:16 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:35.613 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.854 Initializing NVMe Controllers 00:06:47.854 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:06:47.854 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:47.854 Initialization complete. Launching workers. 00:06:47.854 ======================================================== 00:06:47.854 Latency(us) 00:06:47.854 Device Information : IOPS MiB/s Average min max 00:06:47.854 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 22762.49 88.92 2811.03 696.08 12146.14 00:06:47.854 ======================================================== 00:06:47.854 Total : 22762.49 88.92 2811.03 696.08 12146.14 00:06:47.854 00:06:47.854 14:54:27 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:47.855 14:54:27 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:47.855 14:54:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:47.855 14:54:27 -- nvmf/common.sh@117 -- # sync 00:06:47.855 14:54:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:06:47.855 14:54:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:06:47.855 14:54:27 -- nvmf/common.sh@120 -- # set +e 00:06:47.855 14:54:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:06:47.855 14:54:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:06:47.855 rmmod nvme_rdma 00:06:47.855 rmmod nvme_fabrics 00:06:47.855 14:54:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:06:47.855 14:54:27 -- nvmf/common.sh@124 -- # set -e 00:06:47.855 14:54:27 -- nvmf/common.sh@125 -- # return 0 00:06:47.855 14:54:27 -- nvmf/common.sh@478 -- # '[' -n 3337886 ']' 00:06:47.855 14:54:27 -- nvmf/common.sh@479 -- # killprocess 3337886 00:06:47.855 14:54:27 -- common/autotest_common.sh@946 -- # '[' -z 3337886 ']' 00:06:47.855 14:54:27 -- common/autotest_common.sh@950 -- # kill -0 3337886 00:06:47.855 14:54:27 -- common/autotest_common.sh@951 -- # uname 00:06:47.855 14:54:27 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:47.855 14:54:27 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3337886 00:06:47.855 14:54:27 -- common/autotest_common.sh@952 -- # process_name=nvmf 00:06:47.855 14:54:27 -- common/autotest_common.sh@956 -- # '[' nvmf = sudo ']' 00:06:47.855 14:54:27 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3337886' 00:06:47.855 killing process with pid 3337886 00:06:47.855 14:54:27 -- common/autotest_common.sh@965 -- # kill 3337886 00:06:47.855 14:54:27 -- common/autotest_common.sh@970 -- # wait 3337886 00:06:47.855 [2024-04-26 14:54:27.867631] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:47.855 nvmf threads initialize successfully 00:06:47.855 bdev subsystem init successfully 00:06:47.855 created a nvmf target service 00:06:47.855 create targets's poll groups done 00:06:47.855 all subsystems of target started 00:06:47.855 nvmf target is running 00:06:47.855 all subsystems of target stopped 00:06:47.855 destroy targets's poll groups done 00:06:47.855 destroyed the nvmf target service 00:06:47.855 bdev subsystem finish successfully 00:06:47.855 nvmf threads destroy successfully 00:06:47.855 14:54:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:47.855 14:54:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:06:47.855 14:54:27 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:47.855 14:54:27 -- common/autotest_common.sh@726 -- # xtrace_disable 00:06:47.855 14:54:27 -- common/autotest_common.sh@10 -- # set +x 00:06:47.855 00:06:47.855 real 0m19.799s 00:06:47.855 user 0m52.171s 00:06:47.855 sys 0m5.551s 00:06:47.855 14:54:28 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:47.855 14:54:28 -- common/autotest_common.sh@10 -- # set +x 00:06:47.855 ************************************ 00:06:47.855 END TEST nvmf_example 00:06:47.855 ************************************ 00:06:47.855 14:54:28 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:47.855 14:54:28 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:06:47.855 14:54:28 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:47.855 14:54:28 -- common/autotest_common.sh@10 -- # set +x 00:06:47.855 ************************************ 00:06:47.855 START TEST nvmf_filesystem 00:06:47.855 ************************************ 00:06:47.855 14:54:28 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:47.855 * Looking for test storage... 00:06:47.855 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.855 14:54:28 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:06:47.855 14:54:28 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:47.855 14:54:28 -- common/autotest_common.sh@34 -- # set -e 00:06:47.855 14:54:28 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:47.855 14:54:28 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:47.855 14:54:28 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:06:47.855 14:54:28 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:47.855 14:54:28 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:06:47.855 14:54:28 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:47.855 14:54:28 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:47.855 14:54:28 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:47.855 14:54:28 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:47.855 14:54:28 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:47.855 14:54:28 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:47.855 14:54:28 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:47.855 14:54:28 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:47.855 14:54:28 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:47.855 14:54:28 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:47.855 14:54:28 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:47.855 14:54:28 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:47.855 14:54:28 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:47.855 14:54:28 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:47.855 14:54:28 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:47.855 14:54:28 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:47.855 14:54:28 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:06:47.855 14:54:28 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:47.855 14:54:28 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:47.855 14:54:28 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:47.855 14:54:28 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:47.855 14:54:28 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:47.855 14:54:28 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:47.855 14:54:28 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:47.855 14:54:28 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:47.855 14:54:28 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:47.855 14:54:28 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:47.855 14:54:28 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:47.855 14:54:28 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:47.855 14:54:28 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:47.855 14:54:28 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:47.855 14:54:28 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:47.855 14:54:28 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:06:47.855 14:54:28 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:47.855 14:54:28 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:47.855 14:54:28 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:47.855 14:54:28 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:47.855 14:54:28 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:47.855 14:54:28 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:47.855 14:54:28 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:47.855 14:54:28 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:47.855 14:54:28 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:47.855 14:54:28 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:47.855 14:54:28 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:47.855 14:54:28 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:47.855 14:54:28 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:47.855 14:54:28 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:47.855 14:54:28 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:06:47.855 14:54:28 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:06:47.855 14:54:28 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:06:47.855 14:54:28 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:06:47.855 14:54:28 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:06:47.855 14:54:28 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:06:47.855 14:54:28 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:06:47.855 14:54:28 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:06:47.855 14:54:28 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:06:47.855 14:54:28 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:06:47.855 14:54:28 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:06:47.855 14:54:28 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:06:47.855 14:54:28 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:06:47.855 14:54:28 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:47.855 14:54:28 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:06:47.855 14:54:28 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:06:47.855 14:54:28 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:06:47.855 14:54:28 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:06:47.855 14:54:28 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:06:47.855 14:54:28 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:06:47.855 14:54:28 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:06:47.855 14:54:28 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:06:47.855 14:54:28 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:06:47.855 14:54:28 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:06:47.855 14:54:28 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:06:47.855 14:54:28 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:47.855 14:54:28 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:06:47.855 14:54:28 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:06:47.855 14:54:28 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:06:47.855 14:54:28 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:06:47.855 14:54:28 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:06:47.855 14:54:28 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:06:47.856 14:54:28 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:47.856 14:54:28 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:47.856 14:54:28 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:47.856 14:54:28 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:47.856 14:54:28 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:47.856 14:54:28 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:47.856 14:54:28 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:47.856 14:54:28 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:47.856 14:54:28 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:47.856 14:54:28 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:47.856 14:54:28 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:06:47.856 14:54:28 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:47.856 #define SPDK_CONFIG_H 00:06:47.856 #define SPDK_CONFIG_APPS 1 00:06:47.856 #define SPDK_CONFIG_ARCH native 00:06:47.856 #undef SPDK_CONFIG_ASAN 00:06:47.856 #undef SPDK_CONFIG_AVAHI 00:06:47.856 #undef SPDK_CONFIG_CET 00:06:47.856 #define SPDK_CONFIG_COVERAGE 1 00:06:47.856 #define SPDK_CONFIG_CROSS_PREFIX 00:06:47.856 #undef SPDK_CONFIG_CRYPTO 00:06:47.856 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:47.856 #undef SPDK_CONFIG_CUSTOMOCF 00:06:47.856 #undef SPDK_CONFIG_DAOS 00:06:47.856 #define SPDK_CONFIG_DAOS_DIR 00:06:47.856 #define SPDK_CONFIG_DEBUG 1 00:06:47.856 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:47.856 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:06:47.856 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:47.856 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:47.856 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:47.856 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:06:47.856 #define SPDK_CONFIG_EXAMPLES 1 00:06:47.856 #undef SPDK_CONFIG_FC 00:06:47.856 #define SPDK_CONFIG_FC_PATH 00:06:47.856 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:47.856 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:47.856 #undef SPDK_CONFIG_FUSE 00:06:47.856 #undef SPDK_CONFIG_FUZZER 00:06:47.856 #define SPDK_CONFIG_FUZZER_LIB 00:06:47.856 #undef SPDK_CONFIG_GOLANG 00:06:47.856 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:47.856 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:06:47.856 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:47.856 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:06:47.856 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:47.856 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:47.856 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:47.856 #define SPDK_CONFIG_IDXD 1 00:06:47.856 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:47.856 #undef SPDK_CONFIG_IPSEC_MB 00:06:47.856 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:47.856 #define SPDK_CONFIG_ISAL 1 00:06:47.856 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:47.856 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:47.856 #define SPDK_CONFIG_LIBDIR 00:06:47.856 #undef SPDK_CONFIG_LTO 00:06:47.856 #define SPDK_CONFIG_MAX_LCORES 00:06:47.856 #define SPDK_CONFIG_NVME_CUSE 1 00:06:47.856 #undef SPDK_CONFIG_OCF 00:06:47.856 #define SPDK_CONFIG_OCF_PATH 00:06:47.856 #define SPDK_CONFIG_OPENSSL_PATH 00:06:47.856 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:47.856 #define SPDK_CONFIG_PGO_DIR 00:06:47.856 #undef SPDK_CONFIG_PGO_USE 00:06:47.856 #define SPDK_CONFIG_PREFIX /usr/local 00:06:47.856 #undef SPDK_CONFIG_RAID5F 00:06:47.856 #undef SPDK_CONFIG_RBD 00:06:47.856 #define SPDK_CONFIG_RDMA 1 00:06:47.856 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:47.856 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:47.856 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:47.856 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:47.856 #define SPDK_CONFIG_SHARED 1 00:06:47.856 #undef SPDK_CONFIG_SMA 00:06:47.856 #define SPDK_CONFIG_TESTS 1 00:06:47.856 #undef SPDK_CONFIG_TSAN 00:06:47.856 #define SPDK_CONFIG_UBLK 1 00:06:47.856 #define SPDK_CONFIG_UBSAN 1 00:06:47.856 #undef SPDK_CONFIG_UNIT_TESTS 00:06:47.856 #undef SPDK_CONFIG_URING 00:06:47.856 #define SPDK_CONFIG_URING_PATH 00:06:47.856 #undef SPDK_CONFIG_URING_ZNS 00:06:47.856 #undef SPDK_CONFIG_USDT 00:06:47.856 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:47.856 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:47.856 #undef SPDK_CONFIG_VFIO_USER 00:06:47.856 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:47.856 #define SPDK_CONFIG_VHOST 1 00:06:47.856 #define SPDK_CONFIG_VIRTIO 1 00:06:47.856 #undef SPDK_CONFIG_VTUNE 00:06:47.856 #define SPDK_CONFIG_VTUNE_DIR 00:06:47.856 #define SPDK_CONFIG_WERROR 1 00:06:47.856 #define SPDK_CONFIG_WPDK_DIR 00:06:47.856 #undef SPDK_CONFIG_XNVME 00:06:47.856 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:47.856 14:54:28 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:47.856 14:54:28 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:47.856 14:54:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:47.856 14:54:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:47.856 14:54:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:47.856 14:54:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.856 14:54:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.856 14:54:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.856 14:54:28 -- paths/export.sh@5 -- # export PATH 00:06:47.856 14:54:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.856 14:54:28 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:06:47.856 14:54:28 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:06:47.856 14:54:28 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:06:47.856 14:54:28 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:06:47.856 14:54:28 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:47.856 14:54:28 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:47.856 14:54:28 -- pm/common@67 -- # TEST_TAG=N/A 00:06:47.856 14:54:28 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:06:47.856 14:54:28 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:06:47.856 14:54:28 -- pm/common@71 -- # uname -s 00:06:47.856 14:54:28 -- pm/common@71 -- # PM_OS=Linux 00:06:47.856 14:54:28 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:06:47.856 14:54:28 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:06:47.856 14:54:28 -- pm/common@76 -- # [[ Linux == Linux ]] 00:06:47.856 14:54:28 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:06:47.856 14:54:28 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:06:47.856 14:54:28 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:06:47.856 14:54:28 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:06:47.856 14:54:28 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:06:47.856 14:54:28 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:06:47.856 14:54:28 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:06:47.856 14:54:28 -- common/autotest_common.sh@57 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:06:47.856 14:54:28 -- common/autotest_common.sh@61 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:47.856 14:54:28 -- common/autotest_common.sh@63 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:06:47.856 14:54:28 -- common/autotest_common.sh@65 -- # : 1 00:06:47.856 14:54:28 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:47.856 14:54:28 -- common/autotest_common.sh@67 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:06:47.856 14:54:28 -- common/autotest_common.sh@69 -- # : 00:06:47.856 14:54:28 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:06:47.856 14:54:28 -- common/autotest_common.sh@71 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:06:47.856 14:54:28 -- common/autotest_common.sh@73 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:06:47.856 14:54:28 -- common/autotest_common.sh@75 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:06:47.856 14:54:28 -- common/autotest_common.sh@77 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:47.856 14:54:28 -- common/autotest_common.sh@79 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:06:47.856 14:54:28 -- common/autotest_common.sh@81 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:06:47.856 14:54:28 -- common/autotest_common.sh@83 -- # : 0 00:06:47.856 14:54:28 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:06:47.857 14:54:28 -- common/autotest_common.sh@85 -- # : 1 00:06:47.857 14:54:28 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:06:47.857 14:54:28 -- common/autotest_common.sh@87 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:06:47.857 14:54:28 -- common/autotest_common.sh@89 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:06:47.857 14:54:28 -- common/autotest_common.sh@91 -- # : 1 00:06:47.857 14:54:28 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:06:47.857 14:54:28 -- common/autotest_common.sh@93 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:06:47.857 14:54:28 -- common/autotest_common.sh@95 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:47.857 14:54:28 -- common/autotest_common.sh@97 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:06:47.857 14:54:28 -- common/autotest_common.sh@99 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:06:47.857 14:54:28 -- common/autotest_common.sh@101 -- # : rdma 00:06:47.857 14:54:28 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:47.857 14:54:28 -- common/autotest_common.sh@103 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:06:47.857 14:54:28 -- common/autotest_common.sh@105 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:06:47.857 14:54:28 -- common/autotest_common.sh@107 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:06:47.857 14:54:28 -- common/autotest_common.sh@109 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:06:47.857 14:54:28 -- common/autotest_common.sh@111 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:06:47.857 14:54:28 -- common/autotest_common.sh@113 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:06:47.857 14:54:28 -- common/autotest_common.sh@115 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:06:47.857 14:54:28 -- common/autotest_common.sh@117 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:47.857 14:54:28 -- common/autotest_common.sh@119 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:06:47.857 14:54:28 -- common/autotest_common.sh@121 -- # : 1 00:06:47.857 14:54:28 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:06:47.857 14:54:28 -- common/autotest_common.sh@123 -- # : 00:06:47.857 14:54:28 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:47.857 14:54:28 -- common/autotest_common.sh@125 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:06:47.857 14:54:28 -- common/autotest_common.sh@127 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:06:47.857 14:54:28 -- common/autotest_common.sh@129 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:06:47.857 14:54:28 -- common/autotest_common.sh@131 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:06:47.857 14:54:28 -- common/autotest_common.sh@133 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:06:47.857 14:54:28 -- common/autotest_common.sh@135 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:06:47.857 14:54:28 -- common/autotest_common.sh@137 -- # : 00:06:47.857 14:54:28 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:06:47.857 14:54:28 -- common/autotest_common.sh@139 -- # : true 00:06:47.857 14:54:28 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:06:47.857 14:54:28 -- common/autotest_common.sh@141 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:06:47.857 14:54:28 -- common/autotest_common.sh@143 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:06:47.857 14:54:28 -- common/autotest_common.sh@145 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:06:47.857 14:54:28 -- common/autotest_common.sh@147 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:06:47.857 14:54:28 -- common/autotest_common.sh@149 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:06:47.857 14:54:28 -- common/autotest_common.sh@151 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:06:47.857 14:54:28 -- common/autotest_common.sh@153 -- # : mlx5 00:06:47.857 14:54:28 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:06:47.857 14:54:28 -- common/autotest_common.sh@155 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:06:47.857 14:54:28 -- common/autotest_common.sh@157 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:06:47.857 14:54:28 -- common/autotest_common.sh@159 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:06:47.857 14:54:28 -- common/autotest_common.sh@161 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:06:47.857 14:54:28 -- common/autotest_common.sh@163 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:06:47.857 14:54:28 -- common/autotest_common.sh@166 -- # : 00:06:47.857 14:54:28 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:06:47.857 14:54:28 -- common/autotest_common.sh@168 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:06:47.857 14:54:28 -- common/autotest_common.sh@170 -- # : 0 00:06:47.857 14:54:28 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:47.857 14:54:28 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:47.857 14:54:28 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:47.857 14:54:28 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:47.857 14:54:28 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:47.857 14:54:28 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:47.857 14:54:28 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:47.857 14:54:28 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:06:47.857 14:54:28 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:47.857 14:54:28 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:47.857 14:54:28 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:47.857 14:54:28 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:47.857 14:54:28 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:47.857 14:54:28 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:06:47.857 14:54:28 -- common/autotest_common.sh@199 -- # cat 00:06:47.857 14:54:28 -- common/autotest_common.sh@235 -- # echo leak:libfuse3.so 00:06:47.857 14:54:28 -- common/autotest_common.sh@237 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:47.857 14:54:28 -- common/autotest_common.sh@237 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:47.857 14:54:28 -- common/autotest_common.sh@239 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:47.857 14:54:28 -- common/autotest_common.sh@239 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:47.857 14:54:28 -- common/autotest_common.sh@241 -- # '[' -z /var/spdk/dependencies ']' 00:06:47.857 14:54:28 -- common/autotest_common.sh@244 -- # export DEPENDENCY_DIR 00:06:47.857 14:54:28 -- common/autotest_common.sh@248 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:47.857 14:54:28 -- common/autotest_common.sh@248 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:47.857 14:54:28 -- common/autotest_common.sh@249 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:47.858 14:54:28 -- common/autotest_common.sh@249 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:47.858 14:54:28 -- common/autotest_common.sh@252 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:47.858 14:54:28 -- common/autotest_common.sh@252 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:47.858 14:54:28 -- common/autotest_common.sh@253 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:47.858 14:54:28 -- common/autotest_common.sh@253 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:47.858 14:54:28 -- common/autotest_common.sh@255 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:47.858 14:54:28 -- common/autotest_common.sh@255 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:47.858 14:54:28 -- common/autotest_common.sh@258 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:47.858 14:54:28 -- common/autotest_common.sh@258 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:47.858 14:54:28 -- common/autotest_common.sh@261 -- # '[' 0 -eq 0 ']' 00:06:47.858 14:54:28 -- common/autotest_common.sh@262 -- # export valgrind= 00:06:47.858 14:54:28 -- common/autotest_common.sh@262 -- # valgrind= 00:06:47.858 14:54:28 -- common/autotest_common.sh@268 -- # uname -s 00:06:47.858 14:54:28 -- common/autotest_common.sh@268 -- # '[' Linux = Linux ']' 00:06:47.858 14:54:28 -- common/autotest_common.sh@269 -- # HUGEMEM=4096 00:06:47.858 14:54:28 -- common/autotest_common.sh@270 -- # export CLEAR_HUGE=yes 00:06:47.858 14:54:28 -- common/autotest_common.sh@270 -- # CLEAR_HUGE=yes 00:06:47.858 14:54:28 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@278 -- # MAKE=make 00:06:47.858 14:54:28 -- common/autotest_common.sh@279 -- # MAKEFLAGS=-j144 00:06:47.858 14:54:28 -- common/autotest_common.sh@295 -- # export HUGEMEM=4096 00:06:47.858 14:54:28 -- common/autotest_common.sh@295 -- # HUGEMEM=4096 00:06:47.858 14:54:28 -- common/autotest_common.sh@297 -- # NO_HUGE=() 00:06:47.858 14:54:28 -- common/autotest_common.sh@298 -- # TEST_MODE= 00:06:47.858 14:54:28 -- common/autotest_common.sh@299 -- # for i in "$@" 00:06:47.858 14:54:28 -- common/autotest_common.sh@300 -- # case "$i" in 00:06:47.858 14:54:28 -- common/autotest_common.sh@305 -- # TEST_TRANSPORT=rdma 00:06:47.858 14:54:28 -- common/autotest_common.sh@317 -- # [[ -z 3340401 ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@317 -- # kill -0 3340401 00:06:47.858 14:54:28 -- common/autotest_common.sh@1676 -- # set_test_storage 2147483648 00:06:47.858 14:54:28 -- common/autotest_common.sh@327 -- # [[ -v testdir ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@329 -- # local requested_size=2147483648 00:06:47.858 14:54:28 -- common/autotest_common.sh@330 -- # local mount target_dir 00:06:47.858 14:54:28 -- common/autotest_common.sh@332 -- # local -A mounts fss sizes avails uses 00:06:47.858 14:54:28 -- common/autotest_common.sh@333 -- # local source fs size avail mount use 00:06:47.858 14:54:28 -- common/autotest_common.sh@335 -- # local storage_fallback storage_candidates 00:06:47.858 14:54:28 -- common/autotest_common.sh@337 -- # mktemp -udt spdk.XXXXXX 00:06:47.858 14:54:28 -- common/autotest_common.sh@337 -- # storage_fallback=/tmp/spdk.0C3PJU 00:06:47.858 14:54:28 -- common/autotest_common.sh@342 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:47.858 14:54:28 -- common/autotest_common.sh@344 -- # [[ -n '' ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@349 -- # [[ -n '' ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@354 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0C3PJU/tests/target /tmp/spdk.0C3PJU 00:06:47.858 14:54:28 -- common/autotest_common.sh@357 -- # requested_size=2214592512 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@326 -- # df -T 00:06:47.858 14:54:28 -- common/autotest_common.sh@326 -- # grep -v Filesystem 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_devtmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=devtmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=67108864 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=67108864 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=0 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/pmem0 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=ext2 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=1052192768 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=5284429824 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=4232237056 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_root 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=overlay 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=115714502656 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=129371037696 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=13656535040 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=64682905600 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=64685518848 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=2613248 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=25864503296 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=25874210816 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=9707520 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=efivarfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=efivarfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=234496 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=507904 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=269312 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=64684515328 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=64685518848 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=1003520 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # avails["$mount"]=12937097216 00:06:47.858 14:54:28 -- common/autotest_common.sh@361 -- # sizes["$mount"]=12937101312 00:06:47.858 14:54:28 -- common/autotest_common.sh@362 -- # uses["$mount"]=4096 00:06:47.858 14:54:28 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:06:47.858 14:54:28 -- common/autotest_common.sh@365 -- # printf '* Looking for test storage...\n' 00:06:47.858 * Looking for test storage... 00:06:47.858 14:54:28 -- common/autotest_common.sh@367 -- # local target_space new_size 00:06:47.858 14:54:28 -- common/autotest_common.sh@368 -- # for target_dir in "${storage_candidates[@]}" 00:06:47.858 14:54:28 -- common/autotest_common.sh@371 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.858 14:54:28 -- common/autotest_common.sh@371 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:47.858 14:54:28 -- common/autotest_common.sh@371 -- # mount=/ 00:06:47.858 14:54:28 -- common/autotest_common.sh@373 -- # target_space=115714502656 00:06:47.858 14:54:28 -- common/autotest_common.sh@374 -- # (( target_space == 0 || target_space < requested_size )) 00:06:47.858 14:54:28 -- common/autotest_common.sh@377 -- # (( target_space >= requested_size )) 00:06:47.858 14:54:28 -- common/autotest_common.sh@379 -- # [[ overlay == tmpfs ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@379 -- # [[ overlay == ramfs ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@379 -- # [[ / == / ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@380 -- # new_size=15871127552 00:06:47.858 14:54:28 -- common/autotest_common.sh@381 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:47.858 14:54:28 -- common/autotest_common.sh@386 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.858 14:54:28 -- common/autotest_common.sh@386 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.858 14:54:28 -- common/autotest_common.sh@387 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.858 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:47.858 14:54:28 -- common/autotest_common.sh@388 -- # return 0 00:06:47.858 14:54:28 -- common/autotest_common.sh@1678 -- # set -o errtrace 00:06:47.858 14:54:28 -- common/autotest_common.sh@1679 -- # shopt -s extdebug 00:06:47.858 14:54:28 -- common/autotest_common.sh@1680 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:47.858 14:54:28 -- common/autotest_common.sh@1682 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:47.858 14:54:28 -- common/autotest_common.sh@1683 -- # true 00:06:47.858 14:54:28 -- common/autotest_common.sh@1685 -- # xtrace_fd 00:06:47.858 14:54:28 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:47.858 14:54:28 -- common/autotest_common.sh@27 -- # exec 00:06:47.858 14:54:28 -- common/autotest_common.sh@29 -- # exec 00:06:47.858 14:54:28 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:47.858 14:54:28 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:47.858 14:54:28 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:47.858 14:54:28 -- common/autotest_common.sh@18 -- # set -x 00:06:47.858 14:54:28 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:47.858 14:54:28 -- nvmf/common.sh@7 -- # uname -s 00:06:47.858 14:54:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:47.858 14:54:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:47.858 14:54:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:47.858 14:54:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:47.858 14:54:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:47.858 14:54:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:47.858 14:54:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:47.859 14:54:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:47.859 14:54:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:47.859 14:54:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:47.859 14:54:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:47.859 14:54:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:06:47.859 14:54:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:47.859 14:54:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:47.859 14:54:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:47.859 14:54:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:47.859 14:54:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:47.859 14:54:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:47.859 14:54:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:47.859 14:54:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:47.859 14:54:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.859 14:54:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.859 14:54:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.859 14:54:28 -- paths/export.sh@5 -- # export PATH 00:06:47.859 14:54:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:47.859 14:54:28 -- nvmf/common.sh@47 -- # : 0 00:06:47.859 14:54:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:47.859 14:54:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:47.859 14:54:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:47.859 14:54:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:47.859 14:54:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:47.859 14:54:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:47.859 14:54:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:47.859 14:54:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:47.859 14:54:28 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:47.859 14:54:28 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:47.859 14:54:28 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:47.859 14:54:28 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:47.859 14:54:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:47.859 14:54:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:47.859 14:54:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:47.859 14:54:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:47.859 14:54:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:47.859 14:54:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:47.859 14:54:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:47.859 14:54:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:47.859 14:54:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:47.859 14:54:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:47.859 14:54:28 -- common/autotest_common.sh@10 -- # set +x 00:06:54.449 14:54:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:54.449 14:54:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:54.449 14:54:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:54.449 14:54:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:54.449 14:54:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:54.449 14:54:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:54.449 14:54:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:54.449 14:54:35 -- nvmf/common.sh@295 -- # net_devs=() 00:06:54.449 14:54:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:54.449 14:54:35 -- nvmf/common.sh@296 -- # e810=() 00:06:54.449 14:54:35 -- nvmf/common.sh@296 -- # local -ga e810 00:06:54.449 14:54:35 -- nvmf/common.sh@297 -- # x722=() 00:06:54.449 14:54:35 -- nvmf/common.sh@297 -- # local -ga x722 00:06:54.449 14:54:35 -- nvmf/common.sh@298 -- # mlx=() 00:06:54.449 14:54:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:54.449 14:54:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:54.449 14:54:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:06:54.449 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:06:54.449 14:54:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:54.449 14:54:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:06:54.449 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:06:54.449 14:54:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:54.449 14:54:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:54.449 14:54:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:54.449 14:54:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:06:54.449 Found net devices under 0000:31:00.0: mlx_0_0 00:06:54.449 14:54:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:54.449 14:54:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:54.449 14:54:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:06:54.449 Found net devices under 0000:31:00.1: mlx_0_1 00:06:54.449 14:54:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:54.449 14:54:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:54.449 14:54:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:54.449 14:54:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:54.449 14:54:35 -- nvmf/common.sh@58 -- # uname 00:06:54.449 14:54:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:54.449 14:54:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:54.449 14:54:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:54.449 14:54:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:54.449 14:54:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:54.449 14:54:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:54.449 14:54:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:54.449 14:54:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:54.449 14:54:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:54.449 14:54:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:54.449 14:54:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:54.449 14:54:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:54.449 14:54:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:54.449 14:54:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:54.449 14:54:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:54.449 14:54:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:54.449 14:54:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:54.449 14:54:35 -- nvmf/common.sh@105 -- # continue 2 00:06:54.449 14:54:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.449 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:54.449 14:54:35 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:54.449 14:54:35 -- nvmf/common.sh@105 -- # continue 2 00:06:54.449 14:54:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:54.449 14:54:35 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:54.449 14:54:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:54.449 14:54:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:54.450 14:54:35 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:54.450 14:54:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:54.450 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:54.450 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:06:54.450 altname enp49s0f0np0 00:06:54.450 altname ens786f0np0 00:06:54.450 inet 192.168.100.8/24 scope global mlx_0_0 00:06:54.450 valid_lft forever preferred_lft forever 00:06:54.450 14:54:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:54.450 14:54:35 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:54.450 14:54:35 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:54.450 14:54:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:54.450 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:54.450 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:06:54.450 altname enp49s0f1np1 00:06:54.450 altname ens786f1np1 00:06:54.450 inet 192.168.100.9/24 scope global mlx_0_1 00:06:54.450 valid_lft forever preferred_lft forever 00:06:54.450 14:54:35 -- nvmf/common.sh@411 -- # return 0 00:06:54.450 14:54:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:54.450 14:54:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:54.450 14:54:35 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:54.450 14:54:35 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:54.450 14:54:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:54.450 14:54:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:54.450 14:54:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:54.450 14:54:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:54.450 14:54:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:54.450 14:54:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:54.450 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.450 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:54.450 14:54:35 -- nvmf/common.sh@105 -- # continue 2 00:06:54.450 14:54:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:54.450 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.450 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:54.450 14:54:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:54.450 14:54:35 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@105 -- # continue 2 00:06:54.450 14:54:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:54.450 14:54:35 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:54.450 14:54:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:54.450 14:54:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:54.450 14:54:35 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:54.450 14:54:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:54.450 14:54:35 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:54.450 192.168.100.9' 00:06:54.450 14:54:35 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:54.450 192.168.100.9' 00:06:54.450 14:54:35 -- nvmf/common.sh@446 -- # head -n 1 00:06:54.450 14:54:35 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:54.450 14:54:35 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:54.450 192.168.100.9' 00:06:54.450 14:54:35 -- nvmf/common.sh@447 -- # tail -n +2 00:06:54.450 14:54:35 -- nvmf/common.sh@447 -- # head -n 1 00:06:54.450 14:54:35 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:54.450 14:54:35 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:54.450 14:54:35 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:54.450 14:54:35 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:54.450 14:54:35 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:54.450 14:54:35 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:54.450 14:54:35 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:54.450 14:54:35 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:06:54.450 14:54:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:54.450 14:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:54.713 ************************************ 00:06:54.713 START TEST nvmf_filesystem_no_in_capsule 00:06:54.713 ************************************ 00:06:54.713 14:54:35 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_part 0 00:06:54.713 14:54:35 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:54.713 14:54:35 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:54.713 14:54:35 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:54.713 14:54:35 -- common/autotest_common.sh@720 -- # xtrace_disable 00:06:54.713 14:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:54.713 14:54:35 -- nvmf/common.sh@470 -- # nvmfpid=3344314 00:06:54.713 14:54:35 -- nvmf/common.sh@471 -- # waitforlisten 3344314 00:06:54.713 14:54:35 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:54.713 14:54:35 -- common/autotest_common.sh@827 -- # '[' -z 3344314 ']' 00:06:54.713 14:54:35 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:54.713 14:54:35 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:54.713 14:54:35 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:54.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:54.713 14:54:35 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:54.713 14:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:54.713 [2024-04-26 14:54:35.526372] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:06:54.713 [2024-04-26 14:54:35.526418] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:54.713 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.713 [2024-04-26 14:54:35.586194] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:54.713 [2024-04-26 14:54:35.651773] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:54.713 [2024-04-26 14:54:35.651810] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:54.713 [2024-04-26 14:54:35.651822] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:54.713 [2024-04-26 14:54:35.651829] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:54.713 [2024-04-26 14:54:35.651836] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:54.713 [2024-04-26 14:54:35.651960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:54.713 [2024-04-26 14:54:35.652083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:54.713 [2024-04-26 14:54:35.652207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:54.713 [2024-04-26 14:54:35.652210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.655 14:54:36 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:55.655 14:54:36 -- common/autotest_common.sh@860 -- # return 0 00:06:55.656 14:54:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:55.656 14:54:36 -- common/autotest_common.sh@726 -- # xtrace_disable 00:06:55.656 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.656 14:54:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:55.656 14:54:36 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:55.656 14:54:36 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:06:55.656 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.656 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.656 [2024-04-26 14:54:36.343940] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:55.656 [2024-04-26 14:54:36.373312] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x18a5b00/0x18a9ff0) succeed. 00:06:55.656 [2024-04-26 14:54:36.386538] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x18a7140/0x18eb680) succeed. 00:06:55.656 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.656 14:54:36 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:55.656 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.656 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.656 Malloc1 00:06:55.656 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.656 14:54:36 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:55.656 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.656 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.656 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.656 14:54:36 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:55.656 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.656 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.917 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.917 14:54:36 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:55.917 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.917 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.917 [2024-04-26 14:54:36.619815] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:55.917 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.917 14:54:36 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:55.917 14:54:36 -- common/autotest_common.sh@1374 -- # local bdev_name=Malloc1 00:06:55.917 14:54:36 -- common/autotest_common.sh@1375 -- # local bdev_info 00:06:55.917 14:54:36 -- common/autotest_common.sh@1376 -- # local bs 00:06:55.917 14:54:36 -- common/autotest_common.sh@1377 -- # local nb 00:06:55.917 14:54:36 -- common/autotest_common.sh@1378 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:55.917 14:54:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:55.917 14:54:36 -- common/autotest_common.sh@10 -- # set +x 00:06:55.917 14:54:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:55.917 14:54:36 -- common/autotest_common.sh@1378 -- # bdev_info='[ 00:06:55.917 { 00:06:55.917 "name": "Malloc1", 00:06:55.917 "aliases": [ 00:06:55.917 "ee3491ef-ff4d-40e2-9105-0cce41c9e153" 00:06:55.917 ], 00:06:55.917 "product_name": "Malloc disk", 00:06:55.917 "block_size": 512, 00:06:55.917 "num_blocks": 1048576, 00:06:55.917 "uuid": "ee3491ef-ff4d-40e2-9105-0cce41c9e153", 00:06:55.917 "assigned_rate_limits": { 00:06:55.917 "rw_ios_per_sec": 0, 00:06:55.917 "rw_mbytes_per_sec": 0, 00:06:55.917 "r_mbytes_per_sec": 0, 00:06:55.917 "w_mbytes_per_sec": 0 00:06:55.917 }, 00:06:55.917 "claimed": true, 00:06:55.917 "claim_type": "exclusive_write", 00:06:55.917 "zoned": false, 00:06:55.917 "supported_io_types": { 00:06:55.917 "read": true, 00:06:55.917 "write": true, 00:06:55.917 "unmap": true, 00:06:55.917 "write_zeroes": true, 00:06:55.917 "flush": true, 00:06:55.917 "reset": true, 00:06:55.917 "compare": false, 00:06:55.917 "compare_and_write": false, 00:06:55.917 "abort": true, 00:06:55.917 "nvme_admin": false, 00:06:55.917 "nvme_io": false 00:06:55.917 }, 00:06:55.917 "memory_domains": [ 00:06:55.917 { 00:06:55.917 "dma_device_id": "system", 00:06:55.917 "dma_device_type": 1 00:06:55.917 }, 00:06:55.917 { 00:06:55.917 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:55.917 "dma_device_type": 2 00:06:55.917 } 00:06:55.917 ], 00:06:55.917 "driver_specific": {} 00:06:55.917 } 00:06:55.917 ]' 00:06:55.917 14:54:36 -- common/autotest_common.sh@1379 -- # jq '.[] .block_size' 00:06:55.917 14:54:36 -- common/autotest_common.sh@1379 -- # bs=512 00:06:55.917 14:54:36 -- common/autotest_common.sh@1380 -- # jq '.[] .num_blocks' 00:06:55.917 14:54:36 -- common/autotest_common.sh@1380 -- # nb=1048576 00:06:55.917 14:54:36 -- common/autotest_common.sh@1383 -- # bdev_size=512 00:06:55.917 14:54:36 -- common/autotest_common.sh@1384 -- # echo 512 00:06:55.917 14:54:36 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:55.917 14:54:36 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:02.515 14:54:42 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:02.515 14:54:42 -- common/autotest_common.sh@1194 -- # local i=0 00:07:02.515 14:54:42 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:07:02.515 14:54:42 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:07:02.515 14:54:42 -- common/autotest_common.sh@1201 -- # sleep 2 00:07:03.465 14:54:44 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:07:03.465 14:54:44 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:07:03.465 14:54:44 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:07:03.465 14:54:44 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:07:03.465 14:54:44 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:07:03.465 14:54:44 -- common/autotest_common.sh@1204 -- # return 0 00:07:03.465 14:54:44 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:03.465 14:54:44 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:03.465 14:54:44 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:03.465 14:54:44 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:03.465 14:54:44 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:03.465 14:54:44 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:03.465 14:54:44 -- setup/common.sh@80 -- # echo 536870912 00:07:03.465 14:54:44 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:03.465 14:54:44 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:03.465 14:54:44 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:03.465 14:54:44 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:03.465 14:54:44 -- target/filesystem.sh@69 -- # partprobe 00:07:03.726 14:54:44 -- target/filesystem.sh@70 -- # sleep 1 00:07:04.668 14:54:45 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:04.668 14:54:45 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:04.668 14:54:45 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:04.668 14:54:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:04.668 14:54:45 -- common/autotest_common.sh@10 -- # set +x 00:07:04.668 ************************************ 00:07:04.668 START TEST filesystem_ext4 00:07:04.668 ************************************ 00:07:04.668 14:54:45 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:04.668 14:54:45 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:04.668 14:54:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.668 14:54:45 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:04.668 14:54:45 -- common/autotest_common.sh@922 -- # local fstype=ext4 00:07:04.668 14:54:45 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:04.668 14:54:45 -- common/autotest_common.sh@924 -- # local i=0 00:07:04.668 14:54:45 -- common/autotest_common.sh@925 -- # local force 00:07:04.668 14:54:45 -- common/autotest_common.sh@927 -- # '[' ext4 = ext4 ']' 00:07:04.668 14:54:45 -- common/autotest_common.sh@928 -- # force=-F 00:07:04.668 14:54:45 -- common/autotest_common.sh@933 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:04.668 mke2fs 1.46.5 (30-Dec-2021) 00:07:04.929 Discarding device blocks: 0/522240 done 00:07:04.929 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:04.929 Filesystem UUID: 71940ace-8d40-482c-a08f-a75651585e4f 00:07:04.929 Superblock backups stored on blocks: 00:07:04.929 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:04.929 00:07:04.929 Allocating group tables: 0/64 done 00:07:04.929 Writing inode tables: 0/64 done 00:07:04.929 Creating journal (8192 blocks): done 00:07:04.929 Writing superblocks and filesystem accounting information: 0/64 done 00:07:04.929 00:07:04.929 14:54:45 -- common/autotest_common.sh@941 -- # return 0 00:07:04.929 14:54:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.929 14:54:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.929 14:54:45 -- target/filesystem.sh@25 -- # sync 00:07:04.929 14:54:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.929 14:54:45 -- target/filesystem.sh@27 -- # sync 00:07:04.929 14:54:45 -- target/filesystem.sh@29 -- # i=0 00:07:04.929 14:54:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.929 14:54:45 -- target/filesystem.sh@37 -- # kill -0 3344314 00:07:04.929 14:54:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.929 14:54:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.929 14:54:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.930 14:54:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.930 00:07:04.930 real 0m0.116s 00:07:04.930 user 0m0.016s 00:07:04.930 sys 0m0.044s 00:07:04.930 14:54:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:04.930 14:54:45 -- common/autotest_common.sh@10 -- # set +x 00:07:04.930 ************************************ 00:07:04.930 END TEST filesystem_ext4 00:07:04.930 ************************************ 00:07:04.930 14:54:45 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:04.930 14:54:45 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:04.930 14:54:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:04.930 14:54:45 -- common/autotest_common.sh@10 -- # set +x 00:07:05.191 ************************************ 00:07:05.191 START TEST filesystem_btrfs 00:07:05.191 ************************************ 00:07:05.191 14:54:45 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:05.191 14:54:45 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:05.191 14:54:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.191 14:54:45 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:05.191 14:54:45 -- common/autotest_common.sh@922 -- # local fstype=btrfs 00:07:05.191 14:54:45 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:05.191 14:54:45 -- common/autotest_common.sh@924 -- # local i=0 00:07:05.191 14:54:45 -- common/autotest_common.sh@925 -- # local force 00:07:05.191 14:54:45 -- common/autotest_common.sh@927 -- # '[' btrfs = ext4 ']' 00:07:05.191 14:54:45 -- common/autotest_common.sh@930 -- # force=-f 00:07:05.191 14:54:45 -- common/autotest_common.sh@933 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:05.191 btrfs-progs v6.6.2 00:07:05.191 See https://btrfs.readthedocs.io for more information. 00:07:05.191 00:07:05.191 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:05.191 NOTE: several default settings have changed in version 5.15, please make sure 00:07:05.191 this does not affect your deployments: 00:07:05.191 - DUP for metadata (-m dup) 00:07:05.191 - enabled no-holes (-O no-holes) 00:07:05.191 - enabled free-space-tree (-R free-space-tree) 00:07:05.191 00:07:05.191 Label: (null) 00:07:05.191 UUID: c69718ee-5bda-4c30-9012-0b3539bbbbfb 00:07:05.191 Node size: 16384 00:07:05.191 Sector size: 4096 00:07:05.191 Filesystem size: 510.00MiB 00:07:05.191 Block group profiles: 00:07:05.191 Data: single 8.00MiB 00:07:05.191 Metadata: DUP 32.00MiB 00:07:05.191 System: DUP 8.00MiB 00:07:05.191 SSD detected: yes 00:07:05.191 Zoned device: no 00:07:05.191 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:05.191 Runtime features: free-space-tree 00:07:05.191 Checksum: crc32c 00:07:05.191 Number of devices: 1 00:07:05.191 Devices: 00:07:05.191 ID SIZE PATH 00:07:05.191 1 510.00MiB /dev/nvme0n1p1 00:07:05.191 00:07:05.191 14:54:45 -- common/autotest_common.sh@941 -- # return 0 00:07:05.191 14:54:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:05.191 14:54:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:05.191 14:54:45 -- target/filesystem.sh@25 -- # sync 00:07:05.191 14:54:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:05.191 14:54:46 -- target/filesystem.sh@27 -- # sync 00:07:05.191 14:54:46 -- target/filesystem.sh@29 -- # i=0 00:07:05.191 14:54:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:05.191 14:54:46 -- target/filesystem.sh@37 -- # kill -0 3344314 00:07:05.191 14:54:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:05.191 14:54:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:05.191 14:54:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:05.191 14:54:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:05.191 00:07:05.191 real 0m0.134s 00:07:05.191 user 0m0.021s 00:07:05.191 sys 0m0.062s 00:07:05.191 14:54:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:05.191 14:54:46 -- common/autotest_common.sh@10 -- # set +x 00:07:05.191 ************************************ 00:07:05.191 END TEST filesystem_btrfs 00:07:05.191 ************************************ 00:07:05.191 14:54:46 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:05.191 14:54:46 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:05.191 14:54:46 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:05.191 14:54:46 -- common/autotest_common.sh@10 -- # set +x 00:07:05.453 ************************************ 00:07:05.453 START TEST filesystem_xfs 00:07:05.453 ************************************ 00:07:05.453 14:54:46 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create xfs nvme0n1 00:07:05.453 14:54:46 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:05.453 14:54:46 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:05.453 14:54:46 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:05.453 14:54:46 -- common/autotest_common.sh@922 -- # local fstype=xfs 00:07:05.453 14:54:46 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:05.453 14:54:46 -- common/autotest_common.sh@924 -- # local i=0 00:07:05.453 14:54:46 -- common/autotest_common.sh@925 -- # local force 00:07:05.453 14:54:46 -- common/autotest_common.sh@927 -- # '[' xfs = ext4 ']' 00:07:05.453 14:54:46 -- common/autotest_common.sh@930 -- # force=-f 00:07:05.453 14:54:46 -- common/autotest_common.sh@933 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:05.453 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:05.453 = sectsz=512 attr=2, projid32bit=1 00:07:05.453 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:05.453 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:05.453 data = bsize=4096 blocks=130560, imaxpct=25 00:07:05.453 = sunit=0 swidth=0 blks 00:07:05.453 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:05.453 log =internal log bsize=4096 blocks=16384, version=2 00:07:05.453 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:05.453 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:05.453 Discarding blocks...Done. 00:07:05.453 14:54:46 -- common/autotest_common.sh@941 -- # return 0 00:07:05.453 14:54:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:05.453 14:54:46 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:05.453 14:54:46 -- target/filesystem.sh@25 -- # sync 00:07:05.453 14:54:46 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:05.453 14:54:46 -- target/filesystem.sh@27 -- # sync 00:07:05.453 14:54:46 -- target/filesystem.sh@29 -- # i=0 00:07:05.453 14:54:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:05.453 14:54:46 -- target/filesystem.sh@37 -- # kill -0 3344314 00:07:05.453 14:54:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:05.453 14:54:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:05.453 14:54:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:05.453 14:54:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:05.453 00:07:05.453 real 0m0.153s 00:07:05.453 user 0m0.022s 00:07:05.453 sys 0m0.053s 00:07:05.453 14:54:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:05.453 14:54:46 -- common/autotest_common.sh@10 -- # set +x 00:07:05.453 ************************************ 00:07:05.453 END TEST filesystem_xfs 00:07:05.453 ************************************ 00:07:05.713 14:54:46 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:05.713 14:54:46 -- target/filesystem.sh@93 -- # sync 00:07:05.713 14:54:46 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:09.917 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:09.918 14:54:50 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:09.918 14:54:50 -- common/autotest_common.sh@1215 -- # local i=0 00:07:09.918 14:54:50 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:07:09.918 14:54:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:09.918 14:54:50 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:07:09.918 14:54:50 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:09.918 14:54:50 -- common/autotest_common.sh@1227 -- # return 0 00:07:09.918 14:54:50 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:09.918 14:54:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:09.918 14:54:50 -- common/autotest_common.sh@10 -- # set +x 00:07:09.918 14:54:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:09.918 14:54:50 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:09.918 14:54:50 -- target/filesystem.sh@101 -- # killprocess 3344314 00:07:09.918 14:54:50 -- common/autotest_common.sh@946 -- # '[' -z 3344314 ']' 00:07:09.918 14:54:50 -- common/autotest_common.sh@950 -- # kill -0 3344314 00:07:09.918 14:54:50 -- common/autotest_common.sh@951 -- # uname 00:07:09.918 14:54:50 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:09.918 14:54:50 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3344314 00:07:09.918 14:54:50 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:09.918 14:54:50 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:09.918 14:54:50 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3344314' 00:07:09.918 killing process with pid 3344314 00:07:09.918 14:54:50 -- common/autotest_common.sh@965 -- # kill 3344314 00:07:09.918 14:54:50 -- common/autotest_common.sh@970 -- # wait 3344314 00:07:09.918 [2024-04-26 14:54:50.680069] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:10.178 14:54:50 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:10.178 00:07:10.178 real 0m15.437s 00:07:10.178 user 1m1.121s 00:07:10.178 sys 0m1.173s 00:07:10.178 14:54:50 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:10.178 14:54:50 -- common/autotest_common.sh@10 -- # set +x 00:07:10.178 ************************************ 00:07:10.178 END TEST nvmf_filesystem_no_in_capsule 00:07:10.178 ************************************ 00:07:10.178 14:54:50 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:10.178 14:54:50 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:10.178 14:54:50 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:10.178 14:54:50 -- common/autotest_common.sh@10 -- # set +x 00:07:10.178 ************************************ 00:07:10.178 START TEST nvmf_filesystem_in_capsule 00:07:10.178 ************************************ 00:07:10.178 14:54:51 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_part 4096 00:07:10.178 14:54:51 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:10.178 14:54:51 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:10.178 14:54:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:10.178 14:54:51 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:10.178 14:54:51 -- common/autotest_common.sh@10 -- # set +x 00:07:10.178 14:54:51 -- nvmf/common.sh@470 -- # nvmfpid=3347629 00:07:10.178 14:54:51 -- nvmf/common.sh@471 -- # waitforlisten 3347629 00:07:10.178 14:54:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:10.178 14:54:51 -- common/autotest_common.sh@827 -- # '[' -z 3347629 ']' 00:07:10.178 14:54:51 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:10.178 14:54:51 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:10.178 14:54:51 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:10.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:10.178 14:54:51 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:10.178 14:54:51 -- common/autotest_common.sh@10 -- # set +x 00:07:10.439 [2024-04-26 14:54:51.149247] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:07:10.439 [2024-04-26 14:54:51.149299] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:10.439 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.439 [2024-04-26 14:54:51.209811] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:10.439 [2024-04-26 14:54:51.271414] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:10.439 [2024-04-26 14:54:51.271454] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:10.439 [2024-04-26 14:54:51.271467] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:10.439 [2024-04-26 14:54:51.271475] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:10.439 [2024-04-26 14:54:51.271482] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:10.439 [2024-04-26 14:54:51.271629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:10.439 [2024-04-26 14:54:51.271765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:10.439 [2024-04-26 14:54:51.271894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:10.439 [2024-04-26 14:54:51.271897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.010 14:54:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:11.010 14:54:51 -- common/autotest_common.sh@860 -- # return 0 00:07:11.010 14:54:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:11.010 14:54:51 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:11.010 14:54:51 -- common/autotest_common.sh@10 -- # set +x 00:07:11.271 14:54:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:11.271 14:54:51 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:11.271 14:54:51 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:07:11.271 14:54:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.271 14:54:51 -- common/autotest_common.sh@10 -- # set +x 00:07:11.271 [2024-04-26 14:54:51.995914] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2052b00/0x2056ff0) succeed. 00:07:11.271 [2024-04-26 14:54:52.009310] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2054140/0x2098680) succeed. 00:07:11.271 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.271 14:54:52 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:11.271 14:54:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.271 14:54:52 -- common/autotest_common.sh@10 -- # set +x 00:07:11.533 Malloc1 00:07:11.533 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.533 14:54:52 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:11.533 14:54:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.533 14:54:52 -- common/autotest_common.sh@10 -- # set +x 00:07:11.533 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.533 14:54:52 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:11.533 14:54:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.533 14:54:52 -- common/autotest_common.sh@10 -- # set +x 00:07:11.533 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.533 14:54:52 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:11.533 14:54:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.533 14:54:52 -- common/autotest_common.sh@10 -- # set +x 00:07:11.533 [2024-04-26 14:54:52.257184] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:11.533 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.533 14:54:52 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:11.533 14:54:52 -- common/autotest_common.sh@1374 -- # local bdev_name=Malloc1 00:07:11.533 14:54:52 -- common/autotest_common.sh@1375 -- # local bdev_info 00:07:11.533 14:54:52 -- common/autotest_common.sh@1376 -- # local bs 00:07:11.533 14:54:52 -- common/autotest_common.sh@1377 -- # local nb 00:07:11.533 14:54:52 -- common/autotest_common.sh@1378 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:11.533 14:54:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:11.533 14:54:52 -- common/autotest_common.sh@10 -- # set +x 00:07:11.533 14:54:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:11.533 14:54:52 -- common/autotest_common.sh@1378 -- # bdev_info='[ 00:07:11.533 { 00:07:11.533 "name": "Malloc1", 00:07:11.533 "aliases": [ 00:07:11.533 "18e0bb07-057a-4498-8790-0a114f20d1f3" 00:07:11.533 ], 00:07:11.533 "product_name": "Malloc disk", 00:07:11.533 "block_size": 512, 00:07:11.533 "num_blocks": 1048576, 00:07:11.533 "uuid": "18e0bb07-057a-4498-8790-0a114f20d1f3", 00:07:11.533 "assigned_rate_limits": { 00:07:11.533 "rw_ios_per_sec": 0, 00:07:11.533 "rw_mbytes_per_sec": 0, 00:07:11.533 "r_mbytes_per_sec": 0, 00:07:11.533 "w_mbytes_per_sec": 0 00:07:11.533 }, 00:07:11.533 "claimed": true, 00:07:11.533 "claim_type": "exclusive_write", 00:07:11.533 "zoned": false, 00:07:11.533 "supported_io_types": { 00:07:11.533 "read": true, 00:07:11.533 "write": true, 00:07:11.533 "unmap": true, 00:07:11.533 "write_zeroes": true, 00:07:11.533 "flush": true, 00:07:11.533 "reset": true, 00:07:11.533 "compare": false, 00:07:11.533 "compare_and_write": false, 00:07:11.533 "abort": true, 00:07:11.533 "nvme_admin": false, 00:07:11.533 "nvme_io": false 00:07:11.533 }, 00:07:11.533 "memory_domains": [ 00:07:11.533 { 00:07:11.533 "dma_device_id": "system", 00:07:11.533 "dma_device_type": 1 00:07:11.533 }, 00:07:11.533 { 00:07:11.533 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:11.533 "dma_device_type": 2 00:07:11.533 } 00:07:11.533 ], 00:07:11.533 "driver_specific": {} 00:07:11.533 } 00:07:11.533 ]' 00:07:11.533 14:54:52 -- common/autotest_common.sh@1379 -- # jq '.[] .block_size' 00:07:11.533 14:54:52 -- common/autotest_common.sh@1379 -- # bs=512 00:07:11.533 14:54:52 -- common/autotest_common.sh@1380 -- # jq '.[] .num_blocks' 00:07:11.533 14:54:52 -- common/autotest_common.sh@1380 -- # nb=1048576 00:07:11.533 14:54:52 -- common/autotest_common.sh@1383 -- # bdev_size=512 00:07:11.533 14:54:52 -- common/autotest_common.sh@1384 -- # echo 512 00:07:11.533 14:54:52 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:11.533 14:54:52 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:16.839 14:54:57 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:16.839 14:54:57 -- common/autotest_common.sh@1194 -- # local i=0 00:07:16.839 14:54:57 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:07:16.839 14:54:57 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:07:16.839 14:54:57 -- common/autotest_common.sh@1201 -- # sleep 2 00:07:18.754 14:54:59 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:07:18.754 14:54:59 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:07:18.754 14:54:59 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:07:18.754 14:54:59 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:07:18.754 14:54:59 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:07:18.754 14:54:59 -- common/autotest_common.sh@1204 -- # return 0 00:07:18.754 14:54:59 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:18.754 14:54:59 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:18.754 14:54:59 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:18.754 14:54:59 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:18.754 14:54:59 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:18.754 14:54:59 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:18.754 14:54:59 -- setup/common.sh@80 -- # echo 536870912 00:07:18.754 14:54:59 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:18.754 14:54:59 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:18.754 14:54:59 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:18.754 14:54:59 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:18.754 14:54:59 -- target/filesystem.sh@69 -- # partprobe 00:07:18.754 14:54:59 -- target/filesystem.sh@70 -- # sleep 1 00:07:19.804 14:55:00 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:19.804 14:55:00 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:19.804 14:55:00 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:19.804 14:55:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:19.804 14:55:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.065 ************************************ 00:07:20.065 START TEST filesystem_in_capsule_ext4 00:07:20.065 ************************************ 00:07:20.065 14:55:00 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:20.065 14:55:00 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:20.065 14:55:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.065 14:55:00 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:20.065 14:55:00 -- common/autotest_common.sh@922 -- # local fstype=ext4 00:07:20.065 14:55:00 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:20.065 14:55:00 -- common/autotest_common.sh@924 -- # local i=0 00:07:20.065 14:55:00 -- common/autotest_common.sh@925 -- # local force 00:07:20.065 14:55:00 -- common/autotest_common.sh@927 -- # '[' ext4 = ext4 ']' 00:07:20.065 14:55:00 -- common/autotest_common.sh@928 -- # force=-F 00:07:20.065 14:55:00 -- common/autotest_common.sh@933 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:20.065 mke2fs 1.46.5 (30-Dec-2021) 00:07:20.065 Discarding device blocks: 0/522240 done 00:07:20.065 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:20.065 Filesystem UUID: c7d41839-7bb2-4423-a3c8-bc6a48315788 00:07:20.065 Superblock backups stored on blocks: 00:07:20.065 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:20.065 00:07:20.065 Allocating group tables: 0/64 done 00:07:20.065 Writing inode tables: 0/64 done 00:07:20.065 Creating journal (8192 blocks): done 00:07:20.065 Writing superblocks and filesystem accounting information: 0/64 done 00:07:20.065 00:07:20.065 14:55:00 -- common/autotest_common.sh@941 -- # return 0 00:07:20.065 14:55:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.065 14:55:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.065 14:55:00 -- target/filesystem.sh@25 -- # sync 00:07:20.065 14:55:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.065 14:55:00 -- target/filesystem.sh@27 -- # sync 00:07:20.065 14:55:00 -- target/filesystem.sh@29 -- # i=0 00:07:20.065 14:55:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.065 14:55:00 -- target/filesystem.sh@37 -- # kill -0 3347629 00:07:20.065 14:55:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.065 14:55:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.065 14:55:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.065 14:55:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.065 00:07:20.065 real 0m0.124s 00:07:20.065 user 0m0.015s 00:07:20.065 sys 0m0.053s 00:07:20.065 14:55:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:20.065 14:55:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.065 ************************************ 00:07:20.065 END TEST filesystem_in_capsule_ext4 00:07:20.065 ************************************ 00:07:20.065 14:55:01 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:20.065 14:55:01 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:20.065 14:55:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:20.065 14:55:01 -- common/autotest_common.sh@10 -- # set +x 00:07:20.327 ************************************ 00:07:20.327 START TEST filesystem_in_capsule_btrfs 00:07:20.327 ************************************ 00:07:20.327 14:55:01 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:20.327 14:55:01 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:20.327 14:55:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.327 14:55:01 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:20.327 14:55:01 -- common/autotest_common.sh@922 -- # local fstype=btrfs 00:07:20.327 14:55:01 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:20.327 14:55:01 -- common/autotest_common.sh@924 -- # local i=0 00:07:20.327 14:55:01 -- common/autotest_common.sh@925 -- # local force 00:07:20.327 14:55:01 -- common/autotest_common.sh@927 -- # '[' btrfs = ext4 ']' 00:07:20.327 14:55:01 -- common/autotest_common.sh@930 -- # force=-f 00:07:20.327 14:55:01 -- common/autotest_common.sh@933 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:20.327 btrfs-progs v6.6.2 00:07:20.327 See https://btrfs.readthedocs.io for more information. 00:07:20.327 00:07:20.327 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:20.327 NOTE: several default settings have changed in version 5.15, please make sure 00:07:20.327 this does not affect your deployments: 00:07:20.327 - DUP for metadata (-m dup) 00:07:20.327 - enabled no-holes (-O no-holes) 00:07:20.327 - enabled free-space-tree (-R free-space-tree) 00:07:20.327 00:07:20.327 Label: (null) 00:07:20.327 UUID: cd460f26-f1b4-4b0d-82a5-c25e4b59bfd3 00:07:20.327 Node size: 16384 00:07:20.327 Sector size: 4096 00:07:20.327 Filesystem size: 510.00MiB 00:07:20.327 Block group profiles: 00:07:20.327 Data: single 8.00MiB 00:07:20.327 Metadata: DUP 32.00MiB 00:07:20.327 System: DUP 8.00MiB 00:07:20.327 SSD detected: yes 00:07:20.327 Zoned device: no 00:07:20.327 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:20.327 Runtime features: free-space-tree 00:07:20.327 Checksum: crc32c 00:07:20.327 Number of devices: 1 00:07:20.327 Devices: 00:07:20.327 ID SIZE PATH 00:07:20.327 1 510.00MiB /dev/nvme0n1p1 00:07:20.327 00:07:20.327 14:55:01 -- common/autotest_common.sh@941 -- # return 0 00:07:20.327 14:55:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.327 14:55:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.327 14:55:01 -- target/filesystem.sh@25 -- # sync 00:07:20.327 14:55:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.327 14:55:01 -- target/filesystem.sh@27 -- # sync 00:07:20.327 14:55:01 -- target/filesystem.sh@29 -- # i=0 00:07:20.327 14:55:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.327 14:55:01 -- target/filesystem.sh@37 -- # kill -0 3347629 00:07:20.327 14:55:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.327 14:55:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.588 14:55:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.588 14:55:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.588 00:07:20.588 real 0m0.133s 00:07:20.588 user 0m0.027s 00:07:20.588 sys 0m0.055s 00:07:20.588 14:55:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:20.588 14:55:01 -- common/autotest_common.sh@10 -- # set +x 00:07:20.588 ************************************ 00:07:20.588 END TEST filesystem_in_capsule_btrfs 00:07:20.588 ************************************ 00:07:20.589 14:55:01 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:20.589 14:55:01 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:20.589 14:55:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:20.589 14:55:01 -- common/autotest_common.sh@10 -- # set +x 00:07:20.589 ************************************ 00:07:20.589 START TEST filesystem_in_capsule_xfs 00:07:20.589 ************************************ 00:07:20.589 14:55:01 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create xfs nvme0n1 00:07:20.589 14:55:01 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:20.589 14:55:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.589 14:55:01 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:20.589 14:55:01 -- common/autotest_common.sh@922 -- # local fstype=xfs 00:07:20.589 14:55:01 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:20.589 14:55:01 -- common/autotest_common.sh@924 -- # local i=0 00:07:20.589 14:55:01 -- common/autotest_common.sh@925 -- # local force 00:07:20.589 14:55:01 -- common/autotest_common.sh@927 -- # '[' xfs = ext4 ']' 00:07:20.589 14:55:01 -- common/autotest_common.sh@930 -- # force=-f 00:07:20.589 14:55:01 -- common/autotest_common.sh@933 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:20.589 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:20.589 = sectsz=512 attr=2, projid32bit=1 00:07:20.589 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:20.589 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:20.589 data = bsize=4096 blocks=130560, imaxpct=25 00:07:20.589 = sunit=0 swidth=0 blks 00:07:20.589 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:20.589 log =internal log bsize=4096 blocks=16384, version=2 00:07:20.589 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:20.589 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:20.850 Discarding blocks...Done. 00:07:20.850 14:55:01 -- common/autotest_common.sh@941 -- # return 0 00:07:20.850 14:55:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.850 14:55:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.850 14:55:01 -- target/filesystem.sh@25 -- # sync 00:07:20.851 14:55:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.851 14:55:01 -- target/filesystem.sh@27 -- # sync 00:07:20.851 14:55:01 -- target/filesystem.sh@29 -- # i=0 00:07:20.851 14:55:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.851 14:55:01 -- target/filesystem.sh@37 -- # kill -0 3347629 00:07:20.851 14:55:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.851 14:55:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.851 14:55:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.851 14:55:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.851 00:07:20.851 real 0m0.132s 00:07:20.851 user 0m0.021s 00:07:20.851 sys 0m0.044s 00:07:20.851 14:55:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:20.851 14:55:01 -- common/autotest_common.sh@10 -- # set +x 00:07:20.851 ************************************ 00:07:20.851 END TEST filesystem_in_capsule_xfs 00:07:20.851 ************************************ 00:07:20.851 14:55:01 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:20.851 14:55:01 -- target/filesystem.sh@93 -- # sync 00:07:20.851 14:55:01 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:25.060 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:25.060 14:55:05 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:25.060 14:55:05 -- common/autotest_common.sh@1215 -- # local i=0 00:07:25.060 14:55:05 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:07:25.060 14:55:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:25.060 14:55:05 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:07:25.060 14:55:05 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:25.060 14:55:05 -- common/autotest_common.sh@1227 -- # return 0 00:07:25.060 14:55:05 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:25.060 14:55:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.060 14:55:05 -- common/autotest_common.sh@10 -- # set +x 00:07:25.060 14:55:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.060 14:55:05 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:25.060 14:55:05 -- target/filesystem.sh@101 -- # killprocess 3347629 00:07:25.060 14:55:05 -- common/autotest_common.sh@946 -- # '[' -z 3347629 ']' 00:07:25.060 14:55:05 -- common/autotest_common.sh@950 -- # kill -0 3347629 00:07:25.060 14:55:05 -- common/autotest_common.sh@951 -- # uname 00:07:25.060 14:55:05 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:25.060 14:55:05 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3347629 00:07:25.060 14:55:05 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:25.060 14:55:05 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:25.060 14:55:05 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3347629' 00:07:25.060 killing process with pid 3347629 00:07:25.060 14:55:05 -- common/autotest_common.sh@965 -- # kill 3347629 00:07:25.060 14:55:05 -- common/autotest_common.sh@970 -- # wait 3347629 00:07:25.320 [2024-04-26 14:55:06.065132] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:25.581 14:55:06 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:25.581 00:07:25.581 real 0m15.198s 00:07:25.581 user 1m0.126s 00:07:25.581 sys 0m1.221s 00:07:25.581 14:55:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:25.581 14:55:06 -- common/autotest_common.sh@10 -- # set +x 00:07:25.581 ************************************ 00:07:25.581 END TEST nvmf_filesystem_in_capsule 00:07:25.581 ************************************ 00:07:25.581 14:55:06 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:25.581 14:55:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:25.581 14:55:06 -- nvmf/common.sh@117 -- # sync 00:07:25.581 14:55:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:25.581 14:55:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:25.581 14:55:06 -- nvmf/common.sh@120 -- # set +e 00:07:25.581 14:55:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:25.581 14:55:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:25.581 rmmod nvme_rdma 00:07:25.581 rmmod nvme_fabrics 00:07:25.581 14:55:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:25.581 14:55:06 -- nvmf/common.sh@124 -- # set -e 00:07:25.581 14:55:06 -- nvmf/common.sh@125 -- # return 0 00:07:25.581 14:55:06 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:07:25.581 14:55:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:25.581 14:55:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:25.581 00:07:25.581 real 0m38.188s 00:07:25.581 user 2m3.417s 00:07:25.581 sys 0m7.849s 00:07:25.581 14:55:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:25.581 14:55:06 -- common/autotest_common.sh@10 -- # set +x 00:07:25.581 ************************************ 00:07:25.581 END TEST nvmf_filesystem 00:07:25.581 ************************************ 00:07:25.581 14:55:06 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:25.581 14:55:06 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:25.581 14:55:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:25.581 14:55:06 -- common/autotest_common.sh@10 -- # set +x 00:07:25.843 ************************************ 00:07:25.843 START TEST nvmf_discovery 00:07:25.843 ************************************ 00:07:25.843 14:55:06 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:25.843 * Looking for test storage... 00:07:25.843 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:25.843 14:55:06 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:25.843 14:55:06 -- nvmf/common.sh@7 -- # uname -s 00:07:25.843 14:55:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:25.843 14:55:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:25.843 14:55:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:25.843 14:55:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:25.843 14:55:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:25.843 14:55:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:25.843 14:55:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:25.843 14:55:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:25.843 14:55:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:25.843 14:55:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:25.843 14:55:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:25.843 14:55:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:25.843 14:55:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:25.843 14:55:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:25.843 14:55:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:25.843 14:55:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:25.843 14:55:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:25.843 14:55:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:25.843 14:55:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:25.843 14:55:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:25.843 14:55:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.843 14:55:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.843 14:55:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.843 14:55:06 -- paths/export.sh@5 -- # export PATH 00:07:25.843 14:55:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:25.843 14:55:06 -- nvmf/common.sh@47 -- # : 0 00:07:25.843 14:55:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:25.843 14:55:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:25.843 14:55:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:25.843 14:55:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:25.843 14:55:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:25.843 14:55:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:25.843 14:55:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:25.843 14:55:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:25.843 14:55:06 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:25.843 14:55:06 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:25.843 14:55:06 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:25.843 14:55:06 -- target/discovery.sh@15 -- # hash nvme 00:07:25.843 14:55:06 -- target/discovery.sh@20 -- # nvmftestinit 00:07:25.843 14:55:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:25.843 14:55:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:25.843 14:55:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:25.843 14:55:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:25.843 14:55:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:25.843 14:55:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:25.843 14:55:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:25.843 14:55:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:25.843 14:55:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:25.843 14:55:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:25.843 14:55:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:25.843 14:55:06 -- common/autotest_common.sh@10 -- # set +x 00:07:32.562 14:55:13 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:32.562 14:55:13 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:32.562 14:55:13 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:32.562 14:55:13 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:32.562 14:55:13 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:32.562 14:55:13 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:32.562 14:55:13 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:32.562 14:55:13 -- nvmf/common.sh@295 -- # net_devs=() 00:07:32.562 14:55:13 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:32.562 14:55:13 -- nvmf/common.sh@296 -- # e810=() 00:07:32.562 14:55:13 -- nvmf/common.sh@296 -- # local -ga e810 00:07:32.562 14:55:13 -- nvmf/common.sh@297 -- # x722=() 00:07:32.562 14:55:13 -- nvmf/common.sh@297 -- # local -ga x722 00:07:32.562 14:55:13 -- nvmf/common.sh@298 -- # mlx=() 00:07:32.562 14:55:13 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:32.562 14:55:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:32.562 14:55:13 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:32.562 14:55:13 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:32.562 14:55:13 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:32.562 14:55:13 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:32.562 14:55:13 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:32.563 14:55:13 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:07:32.563 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:07:32.563 14:55:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:32.563 14:55:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:07:32.563 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:07:32.563 14:55:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:32.563 14:55:13 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:32.563 14:55:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:32.563 14:55:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:07:32.563 Found net devices under 0000:31:00.0: mlx_0_0 00:07:32.563 14:55:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:32.563 14:55:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:32.563 14:55:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:07:32.563 Found net devices under 0000:31:00.1: mlx_0_1 00:07:32.563 14:55:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:32.563 14:55:13 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:32.563 14:55:13 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:32.563 14:55:13 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:32.563 14:55:13 -- nvmf/common.sh@58 -- # uname 00:07:32.563 14:55:13 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:32.563 14:55:13 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:32.563 14:55:13 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:32.563 14:55:13 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:32.563 14:55:13 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:32.563 14:55:13 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:32.563 14:55:13 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:32.563 14:55:13 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:32.563 14:55:13 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:32.563 14:55:13 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:32.563 14:55:13 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:32.563 14:55:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:32.563 14:55:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:32.563 14:55:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:32.563 14:55:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:32.563 14:55:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:32.563 14:55:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:32.563 14:55:13 -- nvmf/common.sh@105 -- # continue 2 00:07:32.563 14:55:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.563 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:32.563 14:55:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:32.563 14:55:13 -- nvmf/common.sh@105 -- # continue 2 00:07:32.563 14:55:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:32.563 14:55:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:32.563 14:55:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:32.563 14:55:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:32.563 14:55:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:32.563 14:55:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:32.824 14:55:13 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:32.824 14:55:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:32.824 14:55:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:32.824 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:32.824 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:07:32.824 altname enp49s0f0np0 00:07:32.824 altname ens786f0np0 00:07:32.824 inet 192.168.100.8/24 scope global mlx_0_0 00:07:32.824 valid_lft forever preferred_lft forever 00:07:32.824 14:55:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:32.824 14:55:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:32.824 14:55:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:32.824 14:55:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:32.824 14:55:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:32.824 14:55:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:32.824 14:55:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:32.824 14:55:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:32.824 14:55:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:32.824 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:32.825 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:07:32.825 altname enp49s0f1np1 00:07:32.825 altname ens786f1np1 00:07:32.825 inet 192.168.100.9/24 scope global mlx_0_1 00:07:32.825 valid_lft forever preferred_lft forever 00:07:32.825 14:55:13 -- nvmf/common.sh@411 -- # return 0 00:07:32.825 14:55:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:32.825 14:55:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:32.825 14:55:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:32.825 14:55:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:32.825 14:55:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:32.825 14:55:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:32.825 14:55:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:32.825 14:55:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:32.825 14:55:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:32.825 14:55:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:32.825 14:55:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:32.825 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.825 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:32.825 14:55:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:32.825 14:55:13 -- nvmf/common.sh@105 -- # continue 2 00:07:32.825 14:55:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:32.825 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.825 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:32.825 14:55:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:32.825 14:55:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:32.825 14:55:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:32.825 14:55:13 -- nvmf/common.sh@105 -- # continue 2 00:07:32.825 14:55:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:32.825 14:55:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:32.825 14:55:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:32.825 14:55:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:32.825 14:55:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:32.825 14:55:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:32.825 14:55:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:32.825 14:55:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:32.825 192.168.100.9' 00:07:32.825 14:55:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:32.825 192.168.100.9' 00:07:32.825 14:55:13 -- nvmf/common.sh@446 -- # head -n 1 00:07:32.825 14:55:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:32.825 14:55:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:32.825 192.168.100.9' 00:07:32.825 14:55:13 -- nvmf/common.sh@447 -- # tail -n +2 00:07:32.825 14:55:13 -- nvmf/common.sh@447 -- # head -n 1 00:07:32.825 14:55:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:32.825 14:55:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:32.825 14:55:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:32.825 14:55:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:32.825 14:55:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:32.825 14:55:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:32.825 14:55:13 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:32.825 14:55:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:32.825 14:55:13 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:32.825 14:55:13 -- common/autotest_common.sh@10 -- # set +x 00:07:32.825 14:55:13 -- nvmf/common.sh@470 -- # nvmfpid=3354568 00:07:32.825 14:55:13 -- nvmf/common.sh@471 -- # waitforlisten 3354568 00:07:32.825 14:55:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:32.825 14:55:13 -- common/autotest_common.sh@827 -- # '[' -z 3354568 ']' 00:07:32.825 14:55:13 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:32.825 14:55:13 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:32.825 14:55:13 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:32.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:32.825 14:55:13 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:32.825 14:55:13 -- common/autotest_common.sh@10 -- # set +x 00:07:32.825 [2024-04-26 14:55:13.700545] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:07:32.825 [2024-04-26 14:55:13.700595] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:32.825 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.825 [2024-04-26 14:55:13.759697] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:33.086 [2024-04-26 14:55:13.823227] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:33.086 [2024-04-26 14:55:13.823265] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:33.086 [2024-04-26 14:55:13.823274] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:33.086 [2024-04-26 14:55:13.823288] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:33.086 [2024-04-26 14:55:13.823295] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:33.086 [2024-04-26 14:55:13.823398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:33.086 [2024-04-26 14:55:13.823636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:33.086 [2024-04-26 14:55:13.823761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:33.086 [2024-04-26 14:55:13.823765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.657 14:55:14 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:33.657 14:55:14 -- common/autotest_common.sh@860 -- # return 0 00:07:33.657 14:55:14 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:33.657 14:55:14 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:33.657 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.657 14:55:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:33.657 14:55:14 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:33.657 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.657 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.658 [2024-04-26 14:55:14.547421] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14a1b00/0x14a5ff0) succeed. 00:07:33.658 [2024-04-26 14:55:14.560718] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14a3140/0x14e7680) succeed. 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@26 -- # seq 1 4 00:07:33.919 14:55:14 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:33.919 14:55:14 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 Null1 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 [2024-04-26 14:55:14.734567] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:33.919 14:55:14 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 Null2 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:33.919 14:55:14 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 Null3 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:33.919 14:55:14 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 Null4 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:33.919 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:33.919 14:55:14 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:07:33.919 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:33.919 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:34.180 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.180 14:55:14 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:07:34.180 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.180 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:34.180 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.180 14:55:14 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:07:34.180 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.180 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:34.180 14:55:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.180 14:55:14 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 4420 00:07:34.180 00:07:34.180 Discovery Log Number of Records 6, Generation counter 6 00:07:34.180 =====Discovery Log Entry 0====== 00:07:34.180 trtype: rdma 00:07:34.180 adrfam: ipv4 00:07:34.180 subtype: current discovery subsystem 00:07:34.180 treq: not required 00:07:34.180 portid: 0 00:07:34.180 trsvcid: 4420 00:07:34.180 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:34.180 traddr: 192.168.100.8 00:07:34.180 eflags: explicit discovery connections, duplicate discovery information 00:07:34.180 rdma_prtype: not specified 00:07:34.180 rdma_qptype: connected 00:07:34.180 rdma_cms: rdma-cm 00:07:34.180 rdma_pkey: 0x0000 00:07:34.180 =====Discovery Log Entry 1====== 00:07:34.180 trtype: rdma 00:07:34.180 adrfam: ipv4 00:07:34.180 subtype: nvme subsystem 00:07:34.180 treq: not required 00:07:34.180 portid: 0 00:07:34.180 trsvcid: 4420 00:07:34.180 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:34.180 traddr: 192.168.100.8 00:07:34.180 eflags: none 00:07:34.180 rdma_prtype: not specified 00:07:34.180 rdma_qptype: connected 00:07:34.180 rdma_cms: rdma-cm 00:07:34.180 rdma_pkey: 0x0000 00:07:34.180 =====Discovery Log Entry 2====== 00:07:34.180 trtype: rdma 00:07:34.180 adrfam: ipv4 00:07:34.180 subtype: nvme subsystem 00:07:34.180 treq: not required 00:07:34.180 portid: 0 00:07:34.180 trsvcid: 4420 00:07:34.180 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:34.180 traddr: 192.168.100.8 00:07:34.180 eflags: none 00:07:34.180 rdma_prtype: not specified 00:07:34.180 rdma_qptype: connected 00:07:34.180 rdma_cms: rdma-cm 00:07:34.180 rdma_pkey: 0x0000 00:07:34.180 =====Discovery Log Entry 3====== 00:07:34.180 trtype: rdma 00:07:34.180 adrfam: ipv4 00:07:34.180 subtype: nvme subsystem 00:07:34.180 treq: not required 00:07:34.180 portid: 0 00:07:34.180 trsvcid: 4420 00:07:34.180 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:34.180 traddr: 192.168.100.8 00:07:34.181 eflags: none 00:07:34.181 rdma_prtype: not specified 00:07:34.181 rdma_qptype: connected 00:07:34.181 rdma_cms: rdma-cm 00:07:34.181 rdma_pkey: 0x0000 00:07:34.181 =====Discovery Log Entry 4====== 00:07:34.181 trtype: rdma 00:07:34.181 adrfam: ipv4 00:07:34.181 subtype: nvme subsystem 00:07:34.181 treq: not required 00:07:34.181 portid: 0 00:07:34.181 trsvcid: 4420 00:07:34.181 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:34.181 traddr: 192.168.100.8 00:07:34.181 eflags: none 00:07:34.181 rdma_prtype: not specified 00:07:34.181 rdma_qptype: connected 00:07:34.181 rdma_cms: rdma-cm 00:07:34.181 rdma_pkey: 0x0000 00:07:34.181 =====Discovery Log Entry 5====== 00:07:34.181 trtype: rdma 00:07:34.181 adrfam: ipv4 00:07:34.181 subtype: discovery subsystem referral 00:07:34.181 treq: not required 00:07:34.181 portid: 0 00:07:34.181 trsvcid: 4430 00:07:34.181 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:34.181 traddr: 192.168.100.8 00:07:34.181 eflags: none 00:07:34.181 rdma_prtype: unrecognized 00:07:34.181 rdma_qptype: unrecognized 00:07:34.181 rdma_cms: unrecognized 00:07:34.181 rdma_pkey: 0x0000 00:07:34.181 14:55:14 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:34.181 Perform nvmf subsystem discovery via RPC 00:07:34.181 14:55:14 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:34.181 14:55:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 [2024-04-26 14:55:14.999221] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:34.181 [ 00:07:34.181 { 00:07:34.181 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:34.181 "subtype": "Discovery", 00:07:34.181 "listen_addresses": [ 00:07:34.181 { 00:07:34.181 "transport": "RDMA", 00:07:34.181 "trtype": "RDMA", 00:07:34.181 "adrfam": "IPv4", 00:07:34.181 "traddr": "192.168.100.8", 00:07:34.181 "trsvcid": "4420" 00:07:34.181 } 00:07:34.181 ], 00:07:34.181 "allow_any_host": true, 00:07:34.181 "hosts": [] 00:07:34.181 }, 00:07:34.181 { 00:07:34.181 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:34.181 "subtype": "NVMe", 00:07:34.181 "listen_addresses": [ 00:07:34.181 { 00:07:34.181 "transport": "RDMA", 00:07:34.181 "trtype": "RDMA", 00:07:34.181 "adrfam": "IPv4", 00:07:34.181 "traddr": "192.168.100.8", 00:07:34.181 "trsvcid": "4420" 00:07:34.181 } 00:07:34.181 ], 00:07:34.181 "allow_any_host": true, 00:07:34.181 "hosts": [], 00:07:34.181 "serial_number": "SPDK00000000000001", 00:07:34.181 "model_number": "SPDK bdev Controller", 00:07:34.181 "max_namespaces": 32, 00:07:34.181 "min_cntlid": 1, 00:07:34.181 "max_cntlid": 65519, 00:07:34.181 "namespaces": [ 00:07:34.181 { 00:07:34.181 "nsid": 1, 00:07:34.181 "bdev_name": "Null1", 00:07:34.181 "name": "Null1", 00:07:34.181 "nguid": "1E2351ECB76946B3AAE5A0FB06E3EEF8", 00:07:34.181 "uuid": "1e2351ec-b769-46b3-aae5-a0fb06e3eef8" 00:07:34.181 } 00:07:34.181 ] 00:07:34.181 }, 00:07:34.181 { 00:07:34.181 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:34.181 "subtype": "NVMe", 00:07:34.181 "listen_addresses": [ 00:07:34.181 { 00:07:34.181 "transport": "RDMA", 00:07:34.181 "trtype": "RDMA", 00:07:34.181 "adrfam": "IPv4", 00:07:34.181 "traddr": "192.168.100.8", 00:07:34.181 "trsvcid": "4420" 00:07:34.181 } 00:07:34.181 ], 00:07:34.181 "allow_any_host": true, 00:07:34.181 "hosts": [], 00:07:34.181 "serial_number": "SPDK00000000000002", 00:07:34.181 "model_number": "SPDK bdev Controller", 00:07:34.181 "max_namespaces": 32, 00:07:34.181 "min_cntlid": 1, 00:07:34.181 "max_cntlid": 65519, 00:07:34.181 "namespaces": [ 00:07:34.181 { 00:07:34.181 "nsid": 1, 00:07:34.181 "bdev_name": "Null2", 00:07:34.181 "name": "Null2", 00:07:34.181 "nguid": "1D552F8C828E43E689B2965B48308D82", 00:07:34.181 "uuid": "1d552f8c-828e-43e6-89b2-965b48308d82" 00:07:34.181 } 00:07:34.181 ] 00:07:34.181 }, 00:07:34.181 { 00:07:34.181 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:34.181 "subtype": "NVMe", 00:07:34.181 "listen_addresses": [ 00:07:34.181 { 00:07:34.181 "transport": "RDMA", 00:07:34.181 "trtype": "RDMA", 00:07:34.181 "adrfam": "IPv4", 00:07:34.181 "traddr": "192.168.100.8", 00:07:34.181 "trsvcid": "4420" 00:07:34.181 } 00:07:34.181 ], 00:07:34.181 "allow_any_host": true, 00:07:34.181 "hosts": [], 00:07:34.181 "serial_number": "SPDK00000000000003", 00:07:34.181 "model_number": "SPDK bdev Controller", 00:07:34.181 "max_namespaces": 32, 00:07:34.181 "min_cntlid": 1, 00:07:34.181 "max_cntlid": 65519, 00:07:34.181 "namespaces": [ 00:07:34.181 { 00:07:34.181 "nsid": 1, 00:07:34.181 "bdev_name": "Null3", 00:07:34.181 "name": "Null3", 00:07:34.181 "nguid": "4375F2D28AB84FE79357541C4E0BE697", 00:07:34.181 "uuid": "4375f2d2-8ab8-4fe7-9357-541c4e0be697" 00:07:34.181 } 00:07:34.181 ] 00:07:34.181 }, 00:07:34.181 { 00:07:34.181 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:34.181 "subtype": "NVMe", 00:07:34.181 "listen_addresses": [ 00:07:34.181 { 00:07:34.181 "transport": "RDMA", 00:07:34.181 "trtype": "RDMA", 00:07:34.181 "adrfam": "IPv4", 00:07:34.181 "traddr": "192.168.100.8", 00:07:34.181 "trsvcid": "4420" 00:07:34.181 } 00:07:34.181 ], 00:07:34.181 "allow_any_host": true, 00:07:34.181 "hosts": [], 00:07:34.181 "serial_number": "SPDK00000000000004", 00:07:34.181 "model_number": "SPDK bdev Controller", 00:07:34.181 "max_namespaces": 32, 00:07:34.181 "min_cntlid": 1, 00:07:34.181 "max_cntlid": 65519, 00:07:34.181 "namespaces": [ 00:07:34.181 { 00:07:34.181 "nsid": 1, 00:07:34.181 "bdev_name": "Null4", 00:07:34.181 "name": "Null4", 00:07:34.181 "nguid": "E7A23804884D408A813CCB9A8BEEA318", 00:07:34.181 "uuid": "e7a23804-884d-408a-813c-cb9a8beea318" 00:07:34.181 } 00:07:34.181 ] 00:07:34.181 } 00:07:34.181 ] 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@42 -- # seq 1 4 00:07:34.181 14:55:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.181 14:55:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.181 14:55:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.181 14:55:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:34.181 14:55:15 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.181 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.181 14:55:15 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:34.181 14:55:15 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:34.181 14:55:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:34.181 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.442 14:55:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:34.442 14:55:15 -- target/discovery.sh@49 -- # check_bdevs= 00:07:34.442 14:55:15 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:34.442 14:55:15 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:34.442 14:55:15 -- target/discovery.sh@57 -- # nvmftestfini 00:07:34.442 14:55:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:34.442 14:55:15 -- nvmf/common.sh@117 -- # sync 00:07:34.442 14:55:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:34.442 14:55:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:34.442 14:55:15 -- nvmf/common.sh@120 -- # set +e 00:07:34.442 14:55:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:34.442 14:55:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:34.442 rmmod nvme_rdma 00:07:34.442 rmmod nvme_fabrics 00:07:34.442 14:55:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:34.442 14:55:15 -- nvmf/common.sh@124 -- # set -e 00:07:34.442 14:55:15 -- nvmf/common.sh@125 -- # return 0 00:07:34.442 14:55:15 -- nvmf/common.sh@478 -- # '[' -n 3354568 ']' 00:07:34.443 14:55:15 -- nvmf/common.sh@479 -- # killprocess 3354568 00:07:34.443 14:55:15 -- common/autotest_common.sh@946 -- # '[' -z 3354568 ']' 00:07:34.443 14:55:15 -- common/autotest_common.sh@950 -- # kill -0 3354568 00:07:34.443 14:55:15 -- common/autotest_common.sh@951 -- # uname 00:07:34.443 14:55:15 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:34.443 14:55:15 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3354568 00:07:34.443 14:55:15 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:34.443 14:55:15 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:34.443 14:55:15 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3354568' 00:07:34.443 killing process with pid 3354568 00:07:34.443 14:55:15 -- common/autotest_common.sh@965 -- # kill 3354568 00:07:34.443 [2024-04-26 14:55:15.260254] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:34.443 14:55:15 -- common/autotest_common.sh@970 -- # wait 3354568 00:07:34.443 [2024-04-26 14:55:15.346736] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:34.704 14:55:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:34.704 14:55:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:34.704 00:07:34.704 real 0m8.886s 00:07:34.704 user 0m8.652s 00:07:34.704 sys 0m5.528s 00:07:34.704 14:55:15 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:34.704 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.704 ************************************ 00:07:34.704 END TEST nvmf_discovery 00:07:34.704 ************************************ 00:07:34.704 14:55:15 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:34.704 14:55:15 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:34.704 14:55:15 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:34.704 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:34.965 ************************************ 00:07:34.965 START TEST nvmf_referrals 00:07:34.965 ************************************ 00:07:34.965 14:55:15 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:34.965 * Looking for test storage... 00:07:34.965 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:34.965 14:55:15 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:34.965 14:55:15 -- nvmf/common.sh@7 -- # uname -s 00:07:34.965 14:55:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:34.965 14:55:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:34.965 14:55:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:34.965 14:55:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:34.965 14:55:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:34.965 14:55:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:34.965 14:55:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:34.965 14:55:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:34.965 14:55:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:34.965 14:55:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:34.965 14:55:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:34.965 14:55:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:34.965 14:55:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:34.965 14:55:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:34.965 14:55:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:34.965 14:55:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:34.965 14:55:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:34.965 14:55:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:34.965 14:55:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:34.965 14:55:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:34.965 14:55:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.965 14:55:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.965 14:55:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.965 14:55:15 -- paths/export.sh@5 -- # export PATH 00:07:34.965 14:55:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:34.965 14:55:15 -- nvmf/common.sh@47 -- # : 0 00:07:34.965 14:55:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:34.965 14:55:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:34.965 14:55:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:34.965 14:55:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:34.965 14:55:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:34.965 14:55:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:34.965 14:55:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:34.965 14:55:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:34.965 14:55:15 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:34.965 14:55:15 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:34.965 14:55:15 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:34.965 14:55:15 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:34.965 14:55:15 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:34.965 14:55:15 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:34.965 14:55:15 -- target/referrals.sh@37 -- # nvmftestinit 00:07:34.965 14:55:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:34.965 14:55:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:34.965 14:55:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:34.965 14:55:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:34.965 14:55:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:34.965 14:55:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:34.965 14:55:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:34.965 14:55:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:34.965 14:55:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:34.965 14:55:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:34.965 14:55:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:34.965 14:55:15 -- common/autotest_common.sh@10 -- # set +x 00:07:41.555 14:55:22 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.555 14:55:22 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:41.555 14:55:22 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:41.555 14:55:22 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:41.555 14:55:22 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:41.555 14:55:22 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:41.555 14:55:22 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:41.555 14:55:22 -- nvmf/common.sh@295 -- # net_devs=() 00:07:41.555 14:55:22 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:41.555 14:55:22 -- nvmf/common.sh@296 -- # e810=() 00:07:41.555 14:55:22 -- nvmf/common.sh@296 -- # local -ga e810 00:07:41.555 14:55:22 -- nvmf/common.sh@297 -- # x722=() 00:07:41.555 14:55:22 -- nvmf/common.sh@297 -- # local -ga x722 00:07:41.555 14:55:22 -- nvmf/common.sh@298 -- # mlx=() 00:07:41.555 14:55:22 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:41.555 14:55:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.555 14:55:22 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:41.555 14:55:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.555 14:55:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:07:41.555 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:07:41.555 14:55:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:41.555 14:55:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:41.555 14:55:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:07:41.555 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:07:41.555 14:55:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:41.555 14:55:22 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:41.555 14:55:22 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.555 14:55:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.555 14:55:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.555 14:55:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.555 14:55:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:07:41.555 Found net devices under 0000:31:00.0: mlx_0_0 00:07:41.555 14:55:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:41.555 14:55:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.555 14:55:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:41.555 14:55:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.555 14:55:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:07:41.555 Found net devices under 0000:31:00.1: mlx_0_1 00:07:41.555 14:55:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.555 14:55:22 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:41.555 14:55:22 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:41.555 14:55:22 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:41.555 14:55:22 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:41.555 14:55:22 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:41.555 14:55:22 -- nvmf/common.sh@58 -- # uname 00:07:41.555 14:55:22 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:41.555 14:55:22 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:41.555 14:55:22 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:41.555 14:55:22 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:41.555 14:55:22 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:41.555 14:55:22 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:41.556 14:55:22 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:41.556 14:55:22 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:41.556 14:55:22 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:41.556 14:55:22 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:41.556 14:55:22 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:41.556 14:55:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:41.556 14:55:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:41.556 14:55:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:41.556 14:55:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:41.556 14:55:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:41.556 14:55:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@105 -- # continue 2 00:07:41.556 14:55:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@105 -- # continue 2 00:07:41.556 14:55:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:41.556 14:55:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:41.556 14:55:22 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:41.556 14:55:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:41.556 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:41.556 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:07:41.556 altname enp49s0f0np0 00:07:41.556 altname ens786f0np0 00:07:41.556 inet 192.168.100.8/24 scope global mlx_0_0 00:07:41.556 valid_lft forever preferred_lft forever 00:07:41.556 14:55:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:41.556 14:55:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:41.556 14:55:22 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:41.556 14:55:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:41.556 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:41.556 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:07:41.556 altname enp49s0f1np1 00:07:41.556 altname ens786f1np1 00:07:41.556 inet 192.168.100.9/24 scope global mlx_0_1 00:07:41.556 valid_lft forever preferred_lft forever 00:07:41.556 14:55:22 -- nvmf/common.sh@411 -- # return 0 00:07:41.556 14:55:22 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:41.556 14:55:22 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:41.556 14:55:22 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:41.556 14:55:22 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:41.556 14:55:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:41.556 14:55:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:41.556 14:55:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:41.556 14:55:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:41.556 14:55:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:41.556 14:55:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@105 -- # continue 2 00:07:41.556 14:55:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:41.556 14:55:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:41.556 14:55:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@105 -- # continue 2 00:07:41.556 14:55:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:41.556 14:55:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:41.556 14:55:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:41.556 14:55:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:41.556 14:55:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:41.556 14:55:22 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:41.556 192.168.100.9' 00:07:41.556 14:55:22 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:41.556 192.168.100.9' 00:07:41.556 14:55:22 -- nvmf/common.sh@446 -- # head -n 1 00:07:41.556 14:55:22 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:41.556 14:55:22 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:41.556 192.168.100.9' 00:07:41.556 14:55:22 -- nvmf/common.sh@447 -- # tail -n +2 00:07:41.556 14:55:22 -- nvmf/common.sh@447 -- # head -n 1 00:07:41.556 14:55:22 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:41.556 14:55:22 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:41.556 14:55:22 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:41.556 14:55:22 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:41.556 14:55:22 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:41.556 14:55:22 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:41.556 14:55:22 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:41.556 14:55:22 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:41.556 14:55:22 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:41.556 14:55:22 -- common/autotest_common.sh@10 -- # set +x 00:07:41.556 14:55:22 -- nvmf/common.sh@470 -- # nvmfpid=3358593 00:07:41.556 14:55:22 -- nvmf/common.sh@471 -- # waitforlisten 3358593 00:07:41.556 14:55:22 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:41.556 14:55:22 -- common/autotest_common.sh@827 -- # '[' -z 3358593 ']' 00:07:41.556 14:55:22 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:41.556 14:55:22 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:41.556 14:55:22 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:41.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:41.556 14:55:22 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:41.556 14:55:22 -- common/autotest_common.sh@10 -- # set +x 00:07:41.816 [2024-04-26 14:55:22.512075] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:07:41.816 [2024-04-26 14:55:22.512126] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:41.816 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.816 [2024-04-26 14:55:22.571833] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:41.816 [2024-04-26 14:55:22.635040] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:41.816 [2024-04-26 14:55:22.635080] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:41.816 [2024-04-26 14:55:22.635088] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:41.816 [2024-04-26 14:55:22.635096] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:41.816 [2024-04-26 14:55:22.635103] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:41.816 [2024-04-26 14:55:22.635260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.816 [2024-04-26 14:55:22.635385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.816 [2024-04-26 14:55:22.635550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:41.816 [2024-04-26 14:55:22.635552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.387 14:55:23 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:42.387 14:55:23 -- common/autotest_common.sh@860 -- # return 0 00:07:42.387 14:55:23 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:42.387 14:55:23 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:42.387 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.387 14:55:23 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:42.387 14:55:23 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:42.387 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.387 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 [2024-04-26 14:55:23.358196] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x220bb00/0x220fff0) succeed. 00:07:42.647 [2024-04-26 14:55:23.371464] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x220d140/0x2251680) succeed. 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 [2024-04-26 14:55:23.496319] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- target/referrals.sh@48 -- # jq length 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.647 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.647 14:55:23 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:42.647 14:55:23 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:42.647 14:55:23 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:42.647 14:55:23 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:42.647 14:55:23 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:42.647 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.647 14:55:23 -- target/referrals.sh@21 -- # sort 00:07:42.647 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.907 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.907 14:55:23 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:42.907 14:55:23 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:42.907 14:55:23 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:42.907 14:55:23 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:42.907 14:55:23 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:42.907 14:55:23 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:42.907 14:55:23 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:42.907 14:55:23 -- target/referrals.sh@26 -- # sort 00:07:42.907 14:55:23 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:42.907 14:55:23 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:42.907 14:55:23 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:07:42.907 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.907 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.907 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.907 14:55:23 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:07:42.907 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.907 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.907 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.907 14:55:23 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:07:42.907 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.907 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.907 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.908 14:55:23 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:42.908 14:55:23 -- target/referrals.sh@56 -- # jq length 00:07:42.908 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:42.908 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:42.908 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:42.908 14:55:23 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:42.908 14:55:23 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:42.908 14:55:23 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:42.908 14:55:23 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:42.908 14:55:23 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:42.908 14:55:23 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:42.908 14:55:23 -- target/referrals.sh@26 -- # sort 00:07:43.168 14:55:23 -- target/referrals.sh@26 -- # echo 00:07:43.168 14:55:23 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:43.168 14:55:23 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:07:43.168 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.168 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:43.168 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.168 14:55:23 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:43.168 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.168 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:43.168 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.168 14:55:23 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:43.168 14:55:23 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:43.168 14:55:23 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.168 14:55:23 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:43.168 14:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.168 14:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:43.168 14:55:23 -- target/referrals.sh@21 -- # sort 00:07:43.168 14:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.168 14:55:23 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:43.168 14:55:23 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:43.168 14:55:23 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:43.168 14:55:23 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.168 14:55:23 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.168 14:55:23 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.168 14:55:23 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.168 14:55:23 -- target/referrals.sh@26 -- # sort 00:07:43.168 14:55:24 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:43.168 14:55:24 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:43.168 14:55:24 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:43.168 14:55:24 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:43.168 14:55:24 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:43.168 14:55:24 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.168 14:55:24 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:43.428 14:55:24 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:43.428 14:55:24 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:43.428 14:55:24 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:43.428 14:55:24 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:43.428 14:55:24 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.428 14:55:24 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:43.428 14:55:24 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:43.429 14:55:24 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:43.429 14:55:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.429 14:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:43.429 14:55:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.429 14:55:24 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:43.429 14:55:24 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:43.429 14:55:24 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.429 14:55:24 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:43.429 14:55:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.429 14:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:43.429 14:55:24 -- target/referrals.sh@21 -- # sort 00:07:43.429 14:55:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.429 14:55:24 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:43.429 14:55:24 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:43.429 14:55:24 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:43.429 14:55:24 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.429 14:55:24 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.429 14:55:24 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.429 14:55:24 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.429 14:55:24 -- target/referrals.sh@26 -- # sort 00:07:43.429 14:55:24 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:43.429 14:55:24 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:43.429 14:55:24 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:43.429 14:55:24 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:43.429 14:55:24 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:43.429 14:55:24 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.429 14:55:24 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:43.689 14:55:24 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:43.689 14:55:24 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:43.689 14:55:24 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:43.689 14:55:24 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:43.689 14:55:24 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.689 14:55:24 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:43.689 14:55:24 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:43.689 14:55:24 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:43.689 14:55:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.689 14:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:43.689 14:55:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.689 14:55:24 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.689 14:55:24 -- target/referrals.sh@82 -- # jq length 00:07:43.689 14:55:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:43.689 14:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:43.689 14:55:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:43.689 14:55:24 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:43.689 14:55:24 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:43.689 14:55:24 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.689 14:55:24 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.689 14:55:24 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:43.689 14:55:24 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.689 14:55:24 -- target/referrals.sh@26 -- # sort 00:07:43.950 14:55:24 -- target/referrals.sh@26 -- # echo 00:07:43.950 14:55:24 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:43.950 14:55:24 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:43.950 14:55:24 -- target/referrals.sh@86 -- # nvmftestfini 00:07:43.950 14:55:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:43.950 14:55:24 -- nvmf/common.sh@117 -- # sync 00:07:43.950 14:55:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:43.950 14:55:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:43.950 14:55:24 -- nvmf/common.sh@120 -- # set +e 00:07:43.950 14:55:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:43.950 14:55:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:43.950 rmmod nvme_rdma 00:07:43.950 rmmod nvme_fabrics 00:07:43.951 14:55:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:43.951 14:55:24 -- nvmf/common.sh@124 -- # set -e 00:07:43.951 14:55:24 -- nvmf/common.sh@125 -- # return 0 00:07:43.951 14:55:24 -- nvmf/common.sh@478 -- # '[' -n 3358593 ']' 00:07:43.951 14:55:24 -- nvmf/common.sh@479 -- # killprocess 3358593 00:07:43.951 14:55:24 -- common/autotest_common.sh@946 -- # '[' -z 3358593 ']' 00:07:43.951 14:55:24 -- common/autotest_common.sh@950 -- # kill -0 3358593 00:07:43.951 14:55:24 -- common/autotest_common.sh@951 -- # uname 00:07:43.951 14:55:24 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:43.951 14:55:24 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3358593 00:07:43.951 14:55:24 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:43.951 14:55:24 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:43.951 14:55:24 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3358593' 00:07:43.951 killing process with pid 3358593 00:07:43.951 14:55:24 -- common/autotest_common.sh@965 -- # kill 3358593 00:07:43.951 14:55:24 -- common/autotest_common.sh@970 -- # wait 3358593 00:07:43.951 [2024-04-26 14:55:24.865270] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:44.212 14:55:24 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:44.212 14:55:24 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:44.212 00:07:44.212 real 0m9.332s 00:07:44.212 user 0m11.964s 00:07:44.212 sys 0m5.642s 00:07:44.212 14:55:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:44.212 14:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.212 ************************************ 00:07:44.212 END TEST nvmf_referrals 00:07:44.212 ************************************ 00:07:44.212 14:55:25 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:44.212 14:55:25 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:44.212 14:55:25 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:44.212 14:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:44.474 ************************************ 00:07:44.474 START TEST nvmf_connect_disconnect 00:07:44.474 ************************************ 00:07:44.474 14:55:25 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:44.474 * Looking for test storage... 00:07:44.474 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:44.474 14:55:25 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:44.474 14:55:25 -- nvmf/common.sh@7 -- # uname -s 00:07:44.474 14:55:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:44.474 14:55:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:44.474 14:55:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:44.474 14:55:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:44.474 14:55:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:44.474 14:55:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:44.474 14:55:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:44.474 14:55:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:44.474 14:55:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:44.474 14:55:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:44.474 14:55:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:44.474 14:55:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:07:44.474 14:55:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:44.474 14:55:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:44.474 14:55:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:44.474 14:55:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:44.474 14:55:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:44.474 14:55:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:44.474 14:55:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:44.474 14:55:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:44.475 14:55:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.475 14:55:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.475 14:55:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.475 14:55:25 -- paths/export.sh@5 -- # export PATH 00:07:44.475 14:55:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:44.475 14:55:25 -- nvmf/common.sh@47 -- # : 0 00:07:44.475 14:55:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:44.475 14:55:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:44.475 14:55:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:44.475 14:55:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:44.475 14:55:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:44.475 14:55:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:44.475 14:55:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:44.475 14:55:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:44.475 14:55:25 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:44.475 14:55:25 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:44.475 14:55:25 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:44.475 14:55:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:44.475 14:55:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:44.475 14:55:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:44.475 14:55:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:44.475 14:55:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:44.475 14:55:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:44.475 14:55:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:44.475 14:55:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:44.475 14:55:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:44.475 14:55:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:44.475 14:55:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:44.475 14:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:51.068 14:55:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:51.068 14:55:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:51.068 14:55:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:51.068 14:55:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:51.068 14:55:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:51.068 14:55:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:51.068 14:55:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:51.068 14:55:31 -- nvmf/common.sh@295 -- # net_devs=() 00:07:51.068 14:55:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:51.068 14:55:31 -- nvmf/common.sh@296 -- # e810=() 00:07:51.068 14:55:31 -- nvmf/common.sh@296 -- # local -ga e810 00:07:51.069 14:55:31 -- nvmf/common.sh@297 -- # x722=() 00:07:51.069 14:55:31 -- nvmf/common.sh@297 -- # local -ga x722 00:07:51.069 14:55:31 -- nvmf/common.sh@298 -- # mlx=() 00:07:51.069 14:55:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:51.069 14:55:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:51.069 14:55:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:07:51.069 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:07:51.069 14:55:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:51.069 14:55:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:07:51.069 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:07:51.069 14:55:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:51.069 14:55:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:51.069 14:55:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:51.069 14:55:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:07:51.069 Found net devices under 0000:31:00.0: mlx_0_0 00:07:51.069 14:55:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:51.069 14:55:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:51.069 14:55:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:07:51.069 Found net devices under 0000:31:00.1: mlx_0_1 00:07:51.069 14:55:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:51.069 14:55:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:51.069 14:55:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:51.069 14:55:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:51.069 14:55:31 -- nvmf/common.sh@58 -- # uname 00:07:51.069 14:55:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:51.069 14:55:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:51.069 14:55:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:51.069 14:55:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:51.069 14:55:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:51.069 14:55:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:51.069 14:55:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:51.069 14:55:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:51.069 14:55:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:51.069 14:55:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:51.069 14:55:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:51.069 14:55:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:51.069 14:55:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:51.069 14:55:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:51.069 14:55:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:51.069 14:55:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:51.069 14:55:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:51.069 14:55:31 -- nvmf/common.sh@105 -- # continue 2 00:07:51.069 14:55:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:51.069 14:55:31 -- nvmf/common.sh@105 -- # continue 2 00:07:51.069 14:55:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:51.069 14:55:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:51.069 14:55:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:51.069 14:55:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:51.069 14:55:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:51.069 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:51.069 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:07:51.069 altname enp49s0f0np0 00:07:51.069 altname ens786f0np0 00:07:51.069 inet 192.168.100.8/24 scope global mlx_0_0 00:07:51.069 valid_lft forever preferred_lft forever 00:07:51.069 14:55:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:51.069 14:55:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:51.069 14:55:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:51.069 14:55:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:51.069 14:55:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:51.069 14:55:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:51.069 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:51.069 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:07:51.069 altname enp49s0f1np1 00:07:51.069 altname ens786f1np1 00:07:51.069 inet 192.168.100.9/24 scope global mlx_0_1 00:07:51.069 valid_lft forever preferred_lft forever 00:07:51.069 14:55:31 -- nvmf/common.sh@411 -- # return 0 00:07:51.069 14:55:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:51.069 14:55:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:51.069 14:55:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:51.069 14:55:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:51.069 14:55:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:51.069 14:55:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:51.069 14:55:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:51.069 14:55:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:51.069 14:55:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:51.069 14:55:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:51.069 14:55:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:51.069 14:55:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:51.069 14:55:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:51.069 14:55:32 -- nvmf/common.sh@105 -- # continue 2 00:07:51.069 14:55:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:51.069 14:55:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:51.069 14:55:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:51.069 14:55:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:51.069 14:55:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:51.069 14:55:32 -- nvmf/common.sh@105 -- # continue 2 00:07:51.069 14:55:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:51.069 14:55:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:51.069 14:55:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:51.069 14:55:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:51.069 14:55:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:51.069 14:55:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:51.069 14:55:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:51.069 14:55:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:51.069 14:55:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:51.331 14:55:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:51.331 14:55:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:51.332 14:55:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:51.332 14:55:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:51.332 192.168.100.9' 00:07:51.332 14:55:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:51.332 192.168.100.9' 00:07:51.332 14:55:32 -- nvmf/common.sh@446 -- # head -n 1 00:07:51.332 14:55:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:51.332 14:55:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:51.332 192.168.100.9' 00:07:51.332 14:55:32 -- nvmf/common.sh@447 -- # tail -n +2 00:07:51.332 14:55:32 -- nvmf/common.sh@447 -- # head -n 1 00:07:51.332 14:55:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:51.332 14:55:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:51.332 14:55:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:51.332 14:55:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:51.332 14:55:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:51.332 14:55:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:51.332 14:55:32 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:51.332 14:55:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:51.332 14:55:32 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:51.332 14:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:51.332 14:55:32 -- nvmf/common.sh@470 -- # nvmfpid=3362869 00:07:51.332 14:55:32 -- nvmf/common.sh@471 -- # waitforlisten 3362869 00:07:51.332 14:55:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:51.332 14:55:32 -- common/autotest_common.sh@827 -- # '[' -z 3362869 ']' 00:07:51.332 14:55:32 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:51.332 14:55:32 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:51.332 14:55:32 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:51.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:51.332 14:55:32 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:51.332 14:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:51.332 [2024-04-26 14:55:32.135572] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:07:51.332 [2024-04-26 14:55:32.135638] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:51.332 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.332 [2024-04-26 14:55:32.201488] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:51.332 [2024-04-26 14:55:32.274126] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:51.332 [2024-04-26 14:55:32.274170] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:51.332 [2024-04-26 14:55:32.274179] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:51.332 [2024-04-26 14:55:32.274191] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:51.332 [2024-04-26 14:55:32.274197] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:51.332 [2024-04-26 14:55:32.274252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:51.332 [2024-04-26 14:55:32.274360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:51.332 [2024-04-26 14:55:32.274627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:51.332 [2024-04-26 14:55:32.274632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.274 14:55:32 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:52.274 14:55:32 -- common/autotest_common.sh@860 -- # return 0 00:07:52.274 14:55:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:52.274 14:55:32 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:52.274 14:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 14:55:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:52.274 14:55:32 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:07:52.274 14:55:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:52.274 14:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 [2024-04-26 14:55:32.960940] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:07:52.274 [2024-04-26 14:55:32.990242] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x639b00/0x63dff0) succeed. 00:07:52.274 [2024-04-26 14:55:33.003551] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x63b140/0x67f680) succeed. 00:07:52.274 14:55:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:52.274 14:55:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:52.274 14:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 14:55:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:52.274 14:55:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:52.274 14:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 14:55:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:52.274 14:55:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:52.274 14:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 14:55:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:52.274 14:55:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:52.274 14:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:52.274 [2024-04-26 14:55:33.158189] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:52.274 14:55:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:07:52.274 14:55:33 -- target/connect_disconnect.sh@34 -- # set +x 00:08:04.507 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.087 14:56:29 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:08:49.087 14:56:29 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:08:49.087 14:56:29 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:49.087 14:56:29 -- nvmf/common.sh@117 -- # sync 00:08:49.087 14:56:29 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:49.087 14:56:29 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:49.087 14:56:29 -- nvmf/common.sh@120 -- # set +e 00:08:49.087 14:56:29 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:49.087 14:56:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:49.087 rmmod nvme_rdma 00:08:49.087 rmmod nvme_fabrics 00:08:49.087 14:56:29 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:49.087 14:56:29 -- nvmf/common.sh@124 -- # set -e 00:08:49.087 14:56:29 -- nvmf/common.sh@125 -- # return 0 00:08:49.087 14:56:29 -- nvmf/common.sh@478 -- # '[' -n 3362869 ']' 00:08:49.087 14:56:29 -- nvmf/common.sh@479 -- # killprocess 3362869 00:08:49.087 14:56:29 -- common/autotest_common.sh@946 -- # '[' -z 3362869 ']' 00:08:49.087 14:56:29 -- common/autotest_common.sh@950 -- # kill -0 3362869 00:08:49.087 14:56:29 -- common/autotest_common.sh@951 -- # uname 00:08:49.087 14:56:29 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:49.087 14:56:29 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3362869 00:08:49.087 14:56:29 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:49.087 14:56:29 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:49.087 14:56:29 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3362869' 00:08:49.087 killing process with pid 3362869 00:08:49.087 14:56:29 -- common/autotest_common.sh@965 -- # kill 3362869 00:08:49.087 14:56:29 -- common/autotest_common.sh@970 -- # wait 3362869 00:08:49.087 [2024-04-26 14:56:29.734674] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:49.087 14:56:29 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:49.087 14:56:29 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:49.087 00:08:49.087 real 1m4.708s 00:08:49.087 user 3m51.592s 00:08:49.087 sys 0m6.457s 00:08:49.087 14:56:29 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:49.087 14:56:29 -- common/autotest_common.sh@10 -- # set +x 00:08:49.087 ************************************ 00:08:49.087 END TEST nvmf_connect_disconnect 00:08:49.087 ************************************ 00:08:49.087 14:56:29 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:49.087 14:56:29 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:49.087 14:56:29 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:49.087 14:56:29 -- common/autotest_common.sh@10 -- # set +x 00:08:49.349 ************************************ 00:08:49.349 START TEST nvmf_multitarget 00:08:49.349 ************************************ 00:08:49.349 14:56:30 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:49.349 * Looking for test storage... 00:08:49.349 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:49.349 14:56:30 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:49.349 14:56:30 -- nvmf/common.sh@7 -- # uname -s 00:08:49.349 14:56:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:49.349 14:56:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:49.349 14:56:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:49.349 14:56:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:49.349 14:56:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:49.349 14:56:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:49.349 14:56:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:49.349 14:56:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:49.349 14:56:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:49.349 14:56:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:49.349 14:56:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:49.349 14:56:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:49.349 14:56:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:49.349 14:56:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:49.349 14:56:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:49.349 14:56:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:49.349 14:56:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:49.349 14:56:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:49.349 14:56:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:49.349 14:56:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:49.349 14:56:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.349 14:56:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.349 14:56:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.349 14:56:30 -- paths/export.sh@5 -- # export PATH 00:08:49.349 14:56:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:49.349 14:56:30 -- nvmf/common.sh@47 -- # : 0 00:08:49.349 14:56:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:49.349 14:56:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:49.349 14:56:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:49.349 14:56:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:49.349 14:56:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:49.349 14:56:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:49.349 14:56:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:49.349 14:56:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:49.349 14:56:30 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:08:49.349 14:56:30 -- target/multitarget.sh@15 -- # nvmftestinit 00:08:49.349 14:56:30 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:49.349 14:56:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:49.349 14:56:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:49.349 14:56:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:49.349 14:56:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:49.349 14:56:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:49.350 14:56:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:49.350 14:56:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:49.350 14:56:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:49.350 14:56:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:49.350 14:56:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:49.350 14:56:30 -- common/autotest_common.sh@10 -- # set +x 00:08:55.943 14:56:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:55.943 14:56:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:55.943 14:56:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:55.943 14:56:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:55.943 14:56:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:55.943 14:56:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:55.943 14:56:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:55.943 14:56:36 -- nvmf/common.sh@295 -- # net_devs=() 00:08:55.943 14:56:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:55.943 14:56:36 -- nvmf/common.sh@296 -- # e810=() 00:08:55.943 14:56:36 -- nvmf/common.sh@296 -- # local -ga e810 00:08:55.943 14:56:36 -- nvmf/common.sh@297 -- # x722=() 00:08:55.943 14:56:36 -- nvmf/common.sh@297 -- # local -ga x722 00:08:55.943 14:56:36 -- nvmf/common.sh@298 -- # mlx=() 00:08:55.943 14:56:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:55.943 14:56:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:55.943 14:56:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:55.943 14:56:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:55.943 14:56:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:55.943 14:56:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:55.943 14:56:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:55.943 14:56:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:55.943 14:56:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:08:55.943 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:08:55.943 14:56:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:55.943 14:56:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:55.943 14:56:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:08:55.943 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:08:55.943 14:56:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:55.943 14:56:36 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:08:55.944 14:56:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:55.944 14:56:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:55.944 14:56:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:55.944 14:56:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:55.944 14:56:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.944 14:56:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:55.944 14:56:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.944 14:56:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:08:55.944 Found net devices under 0000:31:00.0: mlx_0_0 00:08:55.944 14:56:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.944 14:56:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:55.944 14:56:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.944 14:56:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:55.944 14:56:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.944 14:56:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:08:55.944 Found net devices under 0000:31:00.1: mlx_0_1 00:08:55.944 14:56:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.944 14:56:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:55.944 14:56:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:55.944 14:56:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:55.944 14:56:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:55.944 14:56:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:55.944 14:56:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:55.944 14:56:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:55.944 14:56:36 -- nvmf/common.sh@58 -- # uname 00:08:55.944 14:56:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:55.944 14:56:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:56.206 14:56:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:56.206 14:56:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:56.206 14:56:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:56.206 14:56:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:56.206 14:56:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:56.206 14:56:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:56.206 14:56:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:56.206 14:56:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:56.206 14:56:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:56.206 14:56:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:56.206 14:56:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:56.206 14:56:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:56.206 14:56:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:56.206 14:56:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:56.206 14:56:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:56.206 14:56:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:56.206 14:56:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:56.206 14:56:36 -- nvmf/common.sh@105 -- # continue 2 00:08:56.206 14:56:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:56.206 14:56:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:56.206 14:56:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:56.206 14:56:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:56.206 14:56:36 -- nvmf/common.sh@105 -- # continue 2 00:08:56.206 14:56:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:56.206 14:56:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:56.206 14:56:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:56.206 14:56:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:56.206 14:56:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:56.206 14:56:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:56.206 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:56.206 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:08:56.206 altname enp49s0f0np0 00:08:56.206 altname ens786f0np0 00:08:56.206 inet 192.168.100.8/24 scope global mlx_0_0 00:08:56.206 valid_lft forever preferred_lft forever 00:08:56.206 14:56:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:56.206 14:56:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:56.206 14:56:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:56.206 14:56:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:56.206 14:56:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:56.206 14:56:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:56.206 14:56:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:56.206 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:56.206 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:08:56.206 altname enp49s0f1np1 00:08:56.206 altname ens786f1np1 00:08:56.206 inet 192.168.100.9/24 scope global mlx_0_1 00:08:56.206 valid_lft forever preferred_lft forever 00:08:56.206 14:56:37 -- nvmf/common.sh@411 -- # return 0 00:08:56.206 14:56:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:56.206 14:56:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:56.206 14:56:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:56.206 14:56:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:56.206 14:56:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:56.206 14:56:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:56.206 14:56:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:56.206 14:56:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:56.206 14:56:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:56.206 14:56:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:56.206 14:56:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:56.206 14:56:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:56.206 14:56:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:56.206 14:56:37 -- nvmf/common.sh@105 -- # continue 2 00:08:56.206 14:56:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:56.206 14:56:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:56.206 14:56:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:56.206 14:56:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:56.206 14:56:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:56.206 14:56:37 -- nvmf/common.sh@105 -- # continue 2 00:08:56.206 14:56:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:56.206 14:56:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:56.206 14:56:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:56.206 14:56:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:56.206 14:56:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:56.206 14:56:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:56.206 14:56:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:56.206 14:56:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:56.206 192.168.100.9' 00:08:56.206 14:56:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:56.206 192.168.100.9' 00:08:56.207 14:56:37 -- nvmf/common.sh@446 -- # head -n 1 00:08:56.207 14:56:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:56.207 14:56:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:56.207 192.168.100.9' 00:08:56.207 14:56:37 -- nvmf/common.sh@447 -- # tail -n +2 00:08:56.207 14:56:37 -- nvmf/common.sh@447 -- # head -n 1 00:08:56.207 14:56:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:56.207 14:56:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:56.207 14:56:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:56.207 14:56:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:56.207 14:56:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:56.207 14:56:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:56.207 14:56:37 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:08:56.207 14:56:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:56.207 14:56:37 -- common/autotest_common.sh@720 -- # xtrace_disable 00:08:56.207 14:56:37 -- common/autotest_common.sh@10 -- # set +x 00:08:56.207 14:56:37 -- nvmf/common.sh@470 -- # nvmfpid=3377958 00:08:56.207 14:56:37 -- nvmf/common.sh@471 -- # waitforlisten 3377958 00:08:56.207 14:56:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:56.207 14:56:37 -- common/autotest_common.sh@827 -- # '[' -z 3377958 ']' 00:08:56.207 14:56:37 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:56.207 14:56:37 -- common/autotest_common.sh@832 -- # local max_retries=100 00:08:56.207 14:56:37 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:56.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:56.207 14:56:37 -- common/autotest_common.sh@836 -- # xtrace_disable 00:08:56.207 14:56:37 -- common/autotest_common.sh@10 -- # set +x 00:08:56.468 [2024-04-26 14:56:37.171436] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:08:56.468 [2024-04-26 14:56:37.171505] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:56.468 EAL: No free 2048 kB hugepages reported on node 1 00:08:56.468 [2024-04-26 14:56:37.236736] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:56.468 [2024-04-26 14:56:37.311813] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:56.468 [2024-04-26 14:56:37.311853] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:56.468 [2024-04-26 14:56:37.311862] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:56.468 [2024-04-26 14:56:37.311873] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:56.468 [2024-04-26 14:56:37.311879] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:56.468 [2024-04-26 14:56:37.311988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:56.468 [2024-04-26 14:56:37.312125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:56.468 [2024-04-26 14:56:37.312274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:56.468 [2024-04-26 14:56:37.312285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.039 14:56:37 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:08:57.040 14:56:37 -- common/autotest_common.sh@860 -- # return 0 00:08:57.040 14:56:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:57.040 14:56:37 -- common/autotest_common.sh@726 -- # xtrace_disable 00:08:57.040 14:56:37 -- common/autotest_common.sh@10 -- # set +x 00:08:57.300 14:56:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:57.300 14:56:37 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:08:57.300 14:56:37 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:57.300 14:56:37 -- target/multitarget.sh@21 -- # jq length 00:08:57.300 14:56:38 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:08:57.300 14:56:38 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:08:57.300 "nvmf_tgt_1" 00:08:57.300 14:56:38 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:08:57.561 "nvmf_tgt_2" 00:08:57.561 14:56:38 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:57.561 14:56:38 -- target/multitarget.sh@28 -- # jq length 00:08:57.561 14:56:38 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:08:57.561 14:56:38 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:08:57.561 true 00:08:57.561 14:56:38 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:08:57.822 true 00:08:57.822 14:56:38 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:57.822 14:56:38 -- target/multitarget.sh@35 -- # jq length 00:08:57.822 14:56:38 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:08:57.822 14:56:38 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:08:57.822 14:56:38 -- target/multitarget.sh@41 -- # nvmftestfini 00:08:57.822 14:56:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:57.822 14:56:38 -- nvmf/common.sh@117 -- # sync 00:08:57.822 14:56:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:57.822 14:56:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:57.822 14:56:38 -- nvmf/common.sh@120 -- # set +e 00:08:57.822 14:56:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:57.822 14:56:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:57.822 rmmod nvme_rdma 00:08:57.822 rmmod nvme_fabrics 00:08:57.822 14:56:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:57.822 14:56:38 -- nvmf/common.sh@124 -- # set -e 00:08:57.822 14:56:38 -- nvmf/common.sh@125 -- # return 0 00:08:57.822 14:56:38 -- nvmf/common.sh@478 -- # '[' -n 3377958 ']' 00:08:57.822 14:56:38 -- nvmf/common.sh@479 -- # killprocess 3377958 00:08:57.822 14:56:38 -- common/autotest_common.sh@946 -- # '[' -z 3377958 ']' 00:08:57.822 14:56:38 -- common/autotest_common.sh@950 -- # kill -0 3377958 00:08:57.822 14:56:38 -- common/autotest_common.sh@951 -- # uname 00:08:57.822 14:56:38 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:57.822 14:56:38 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3377958 00:08:58.084 14:56:38 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:58.084 14:56:38 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:58.084 14:56:38 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3377958' 00:08:58.084 killing process with pid 3377958 00:08:58.084 14:56:38 -- common/autotest_common.sh@965 -- # kill 3377958 00:08:58.084 14:56:38 -- common/autotest_common.sh@970 -- # wait 3377958 00:08:58.084 14:56:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:58.084 14:56:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:58.084 00:08:58.084 real 0m8.847s 00:08:58.084 user 0m9.217s 00:08:58.084 sys 0m5.562s 00:08:58.084 14:56:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:58.084 14:56:38 -- common/autotest_common.sh@10 -- # set +x 00:08:58.084 ************************************ 00:08:58.084 END TEST nvmf_multitarget 00:08:58.084 ************************************ 00:08:58.084 14:56:38 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:58.084 14:56:38 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:58.084 14:56:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:58.084 14:56:38 -- common/autotest_common.sh@10 -- # set +x 00:08:58.346 ************************************ 00:08:58.346 START TEST nvmf_rpc 00:08:58.346 ************************************ 00:08:58.346 14:56:39 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:58.346 * Looking for test storage... 00:08:58.346 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:58.346 14:56:39 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:58.346 14:56:39 -- nvmf/common.sh@7 -- # uname -s 00:08:58.346 14:56:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:58.346 14:56:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:58.346 14:56:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:58.346 14:56:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:58.346 14:56:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:58.346 14:56:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:58.346 14:56:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:58.346 14:56:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:58.346 14:56:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:58.346 14:56:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:58.346 14:56:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:58.346 14:56:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:08:58.346 14:56:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:58.346 14:56:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:58.346 14:56:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:58.346 14:56:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:58.346 14:56:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:58.346 14:56:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:58.346 14:56:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:58.346 14:56:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:58.346 14:56:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:58.346 14:56:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:58.346 14:56:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:58.346 14:56:39 -- paths/export.sh@5 -- # export PATH 00:08:58.346 14:56:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:58.346 14:56:39 -- nvmf/common.sh@47 -- # : 0 00:08:58.346 14:56:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:58.346 14:56:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:58.346 14:56:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:58.346 14:56:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:58.346 14:56:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:58.346 14:56:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:58.346 14:56:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:58.346 14:56:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:58.346 14:56:39 -- target/rpc.sh@11 -- # loops=5 00:08:58.346 14:56:39 -- target/rpc.sh@23 -- # nvmftestinit 00:08:58.346 14:56:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:58.346 14:56:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:58.346 14:56:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:58.346 14:56:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:58.346 14:56:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:58.346 14:56:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:58.346 14:56:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:58.346 14:56:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:58.346 14:56:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:58.346 14:56:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:58.346 14:56:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:58.346 14:56:39 -- common/autotest_common.sh@10 -- # set +x 00:09:06.515 14:56:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:06.515 14:56:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:06.515 14:56:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:06.515 14:56:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:06.515 14:56:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:06.515 14:56:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:06.515 14:56:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:06.515 14:56:45 -- nvmf/common.sh@295 -- # net_devs=() 00:09:06.515 14:56:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:06.515 14:56:45 -- nvmf/common.sh@296 -- # e810=() 00:09:06.515 14:56:45 -- nvmf/common.sh@296 -- # local -ga e810 00:09:06.515 14:56:45 -- nvmf/common.sh@297 -- # x722=() 00:09:06.515 14:56:45 -- nvmf/common.sh@297 -- # local -ga x722 00:09:06.515 14:56:45 -- nvmf/common.sh@298 -- # mlx=() 00:09:06.515 14:56:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:06.515 14:56:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:06.515 14:56:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:06.515 14:56:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:06.515 14:56:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:09:06.515 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:09:06.515 14:56:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:06.515 14:56:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:06.515 14:56:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:09:06.515 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:09:06.515 14:56:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:06.515 14:56:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:06.515 14:56:45 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:06.515 14:56:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:06.515 14:56:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:06.515 14:56:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:06.515 14:56:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:09:06.515 Found net devices under 0000:31:00.0: mlx_0_0 00:09:06.515 14:56:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:06.515 14:56:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:06.515 14:56:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:06.515 14:56:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:06.515 14:56:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:09:06.515 Found net devices under 0000:31:00.1: mlx_0_1 00:09:06.515 14:56:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:06.515 14:56:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:06.515 14:56:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:06.515 14:56:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:06.515 14:56:45 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:06.515 14:56:45 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:06.515 14:56:45 -- nvmf/common.sh@58 -- # uname 00:09:06.515 14:56:45 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:06.515 14:56:45 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:06.515 14:56:45 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:06.515 14:56:45 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:06.515 14:56:45 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:06.515 14:56:45 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:06.515 14:56:45 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:06.515 14:56:45 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:06.515 14:56:45 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:06.515 14:56:45 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:06.515 14:56:45 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:06.515 14:56:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:06.515 14:56:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:06.515 14:56:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:06.515 14:56:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:06.515 14:56:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:06.515 14:56:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:06.515 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.515 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:06.515 14:56:46 -- nvmf/common.sh@105 -- # continue 2 00:09:06.515 14:56:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:06.515 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.515 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.515 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:06.515 14:56:46 -- nvmf/common.sh@105 -- # continue 2 00:09:06.515 14:56:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:06.515 14:56:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:06.515 14:56:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:06.515 14:56:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:06.515 14:56:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:06.515 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:06.515 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:09:06.515 altname enp49s0f0np0 00:09:06.515 altname ens786f0np0 00:09:06.515 inet 192.168.100.8/24 scope global mlx_0_0 00:09:06.515 valid_lft forever preferred_lft forever 00:09:06.515 14:56:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:06.515 14:56:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:06.515 14:56:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:06.515 14:56:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:06.515 14:56:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:06.515 14:56:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:06.515 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:06.515 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:09:06.515 altname enp49s0f1np1 00:09:06.515 altname ens786f1np1 00:09:06.515 inet 192.168.100.9/24 scope global mlx_0_1 00:09:06.515 valid_lft forever preferred_lft forever 00:09:06.515 14:56:46 -- nvmf/common.sh@411 -- # return 0 00:09:06.515 14:56:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:06.515 14:56:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:06.515 14:56:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:06.515 14:56:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:06.515 14:56:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:06.515 14:56:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:06.515 14:56:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:06.515 14:56:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:06.516 14:56:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:06.516 14:56:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:06.516 14:56:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:06.516 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.516 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:06.516 14:56:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:06.516 14:56:46 -- nvmf/common.sh@105 -- # continue 2 00:09:06.516 14:56:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:06.516 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.516 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:06.516 14:56:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:06.516 14:56:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:06.516 14:56:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:06.516 14:56:46 -- nvmf/common.sh@105 -- # continue 2 00:09:06.516 14:56:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:06.516 14:56:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:06.516 14:56:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:06.516 14:56:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:06.516 14:56:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:06.516 14:56:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:06.516 14:56:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:06.516 14:56:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:06.516 192.168.100.9' 00:09:06.516 14:56:46 -- nvmf/common.sh@446 -- # head -n 1 00:09:06.516 14:56:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:06.516 192.168.100.9' 00:09:06.516 14:56:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:06.516 14:56:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:06.516 192.168.100.9' 00:09:06.516 14:56:46 -- nvmf/common.sh@447 -- # tail -n +2 00:09:06.516 14:56:46 -- nvmf/common.sh@447 -- # head -n 1 00:09:06.516 14:56:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:06.516 14:56:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:06.516 14:56:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:06.516 14:56:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:06.516 14:56:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:06.516 14:56:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:06.516 14:56:46 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:09:06.516 14:56:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:06.516 14:56:46 -- common/autotest_common.sh@720 -- # xtrace_disable 00:09:06.516 14:56:46 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 14:56:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:06.516 14:56:46 -- nvmf/common.sh@470 -- # nvmfpid=3382084 00:09:06.516 14:56:46 -- nvmf/common.sh@471 -- # waitforlisten 3382084 00:09:06.516 14:56:46 -- common/autotest_common.sh@827 -- # '[' -z 3382084 ']' 00:09:06.516 14:56:46 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:06.516 14:56:46 -- common/autotest_common.sh@832 -- # local max_retries=100 00:09:06.516 14:56:46 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:06.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:06.516 14:56:46 -- common/autotest_common.sh@836 -- # xtrace_disable 00:09:06.516 14:56:46 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 [2024-04-26 14:56:46.172789] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:09:06.516 [2024-04-26 14:56:46.172843] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:06.516 EAL: No free 2048 kB hugepages reported on node 1 00:09:06.516 [2024-04-26 14:56:46.228209] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:06.516 [2024-04-26 14:56:46.294554] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:06.516 [2024-04-26 14:56:46.294592] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:06.516 [2024-04-26 14:56:46.294601] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:06.516 [2024-04-26 14:56:46.294609] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:06.516 [2024-04-26 14:56:46.294616] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:06.516 [2024-04-26 14:56:46.294758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:06.516 [2024-04-26 14:56:46.294893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:06.516 [2024-04-26 14:56:46.295022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:06.516 [2024-04-26 14:56:46.295025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:06.516 14:56:46 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:09:06.516 14:56:46 -- common/autotest_common.sh@860 -- # return 0 00:09:06.516 14:56:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:06.516 14:56:46 -- common/autotest_common.sh@726 -- # xtrace_disable 00:09:06.516 14:56:46 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 14:56:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:06.516 14:56:47 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:09:06.516 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.516 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.516 14:56:47 -- target/rpc.sh@26 -- # stats='{ 00:09:06.516 "tick_rate": 2400000000, 00:09:06.516 "poll_groups": [ 00:09:06.516 { 00:09:06.516 "name": "nvmf_tgt_poll_group_0", 00:09:06.516 "admin_qpairs": 0, 00:09:06.516 "io_qpairs": 0, 00:09:06.516 "current_admin_qpairs": 0, 00:09:06.516 "current_io_qpairs": 0, 00:09:06.516 "pending_bdev_io": 0, 00:09:06.516 "completed_nvme_io": 0, 00:09:06.516 "transports": [] 00:09:06.516 }, 00:09:06.516 { 00:09:06.516 "name": "nvmf_tgt_poll_group_1", 00:09:06.516 "admin_qpairs": 0, 00:09:06.516 "io_qpairs": 0, 00:09:06.516 "current_admin_qpairs": 0, 00:09:06.516 "current_io_qpairs": 0, 00:09:06.516 "pending_bdev_io": 0, 00:09:06.516 "completed_nvme_io": 0, 00:09:06.516 "transports": [] 00:09:06.516 }, 00:09:06.516 { 00:09:06.516 "name": "nvmf_tgt_poll_group_2", 00:09:06.516 "admin_qpairs": 0, 00:09:06.516 "io_qpairs": 0, 00:09:06.516 "current_admin_qpairs": 0, 00:09:06.516 "current_io_qpairs": 0, 00:09:06.516 "pending_bdev_io": 0, 00:09:06.516 "completed_nvme_io": 0, 00:09:06.516 "transports": [] 00:09:06.516 }, 00:09:06.516 { 00:09:06.516 "name": "nvmf_tgt_poll_group_3", 00:09:06.516 "admin_qpairs": 0, 00:09:06.516 "io_qpairs": 0, 00:09:06.516 "current_admin_qpairs": 0, 00:09:06.516 "current_io_qpairs": 0, 00:09:06.516 "pending_bdev_io": 0, 00:09:06.516 "completed_nvme_io": 0, 00:09:06.516 "transports": [] 00:09:06.516 } 00:09:06.516 ] 00:09:06.516 }' 00:09:06.516 14:56:47 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:09:06.516 14:56:47 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:09:06.516 14:56:47 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:09:06.516 14:56:47 -- target/rpc.sh@15 -- # wc -l 00:09:06.516 14:56:47 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:09:06.516 14:56:47 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:09:06.516 14:56:47 -- target/rpc.sh@29 -- # [[ null == null ]] 00:09:06.516 14:56:47 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:06.516 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.516 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 [2024-04-26 14:56:47.160583] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ff8b00/0x1ffcff0) succeed. 00:09:06.516 [2024-04-26 14:56:47.173734] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ffa140/0x203e680) succeed. 00:09:06.516 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.516 14:56:47 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:09:06.516 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.516 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.516 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.516 14:56:47 -- target/rpc.sh@33 -- # stats='{ 00:09:06.516 "tick_rate": 2400000000, 00:09:06.516 "poll_groups": [ 00:09:06.516 { 00:09:06.516 "name": "nvmf_tgt_poll_group_0", 00:09:06.516 "admin_qpairs": 0, 00:09:06.516 "io_qpairs": 0, 00:09:06.516 "current_admin_qpairs": 0, 00:09:06.516 "current_io_qpairs": 0, 00:09:06.516 "pending_bdev_io": 0, 00:09:06.516 "completed_nvme_io": 0, 00:09:06.516 "transports": [ 00:09:06.516 { 00:09:06.516 "trtype": "RDMA", 00:09:06.516 "pending_data_buffer": 0, 00:09:06.516 "devices": [ 00:09:06.516 { 00:09:06.516 "name": "mlx5_0", 00:09:06.516 "polls": 15176, 00:09:06.516 "idle_polls": 15176, 00:09:06.516 "completions": 0, 00:09:06.516 "requests": 0, 00:09:06.516 "request_latency": 0, 00:09:06.516 "pending_free_request": 0, 00:09:06.516 "pending_rdma_read": 0, 00:09:06.516 "pending_rdma_write": 0, 00:09:06.516 "pending_rdma_send": 0, 00:09:06.516 "total_send_wrs": 0, 00:09:06.516 "send_doorbell_updates": 0, 00:09:06.516 "total_recv_wrs": 4096, 00:09:06.516 "recv_doorbell_updates": 1 00:09:06.516 }, 00:09:06.516 { 00:09:06.516 "name": "mlx5_1", 00:09:06.516 "polls": 15176, 00:09:06.516 "idle_polls": 15176, 00:09:06.516 "completions": 0, 00:09:06.516 "requests": 0, 00:09:06.516 "request_latency": 0, 00:09:06.516 "pending_free_request": 0, 00:09:06.516 "pending_rdma_read": 0, 00:09:06.516 "pending_rdma_write": 0, 00:09:06.516 "pending_rdma_send": 0, 00:09:06.516 "total_send_wrs": 0, 00:09:06.516 "send_doorbell_updates": 0, 00:09:06.516 "total_recv_wrs": 4096, 00:09:06.516 "recv_doorbell_updates": 1 00:09:06.516 } 00:09:06.516 ] 00:09:06.516 } 00:09:06.516 ] 00:09:06.516 }, 00:09:06.516 { 00:09:06.517 "name": "nvmf_tgt_poll_group_1", 00:09:06.517 "admin_qpairs": 0, 00:09:06.517 "io_qpairs": 0, 00:09:06.517 "current_admin_qpairs": 0, 00:09:06.517 "current_io_qpairs": 0, 00:09:06.517 "pending_bdev_io": 0, 00:09:06.517 "completed_nvme_io": 0, 00:09:06.517 "transports": [ 00:09:06.517 { 00:09:06.517 "trtype": "RDMA", 00:09:06.517 "pending_data_buffer": 0, 00:09:06.517 "devices": [ 00:09:06.517 { 00:09:06.517 "name": "mlx5_0", 00:09:06.517 "polls": 15715, 00:09:06.517 "idle_polls": 15715, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 }, 00:09:06.517 { 00:09:06.517 "name": "mlx5_1", 00:09:06.517 "polls": 15715, 00:09:06.517 "idle_polls": 15715, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 }, 00:09:06.517 { 00:09:06.517 "name": "nvmf_tgt_poll_group_2", 00:09:06.517 "admin_qpairs": 0, 00:09:06.517 "io_qpairs": 0, 00:09:06.517 "current_admin_qpairs": 0, 00:09:06.517 "current_io_qpairs": 0, 00:09:06.517 "pending_bdev_io": 0, 00:09:06.517 "completed_nvme_io": 0, 00:09:06.517 "transports": [ 00:09:06.517 { 00:09:06.517 "trtype": "RDMA", 00:09:06.517 "pending_data_buffer": 0, 00:09:06.517 "devices": [ 00:09:06.517 { 00:09:06.517 "name": "mlx5_0", 00:09:06.517 "polls": 5265, 00:09:06.517 "idle_polls": 5265, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 }, 00:09:06.517 { 00:09:06.517 "name": "mlx5_1", 00:09:06.517 "polls": 5265, 00:09:06.517 "idle_polls": 5265, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 }, 00:09:06.517 { 00:09:06.517 "name": "nvmf_tgt_poll_group_3", 00:09:06.517 "admin_qpairs": 0, 00:09:06.517 "io_qpairs": 0, 00:09:06.517 "current_admin_qpairs": 0, 00:09:06.517 "current_io_qpairs": 0, 00:09:06.517 "pending_bdev_io": 0, 00:09:06.517 "completed_nvme_io": 0, 00:09:06.517 "transports": [ 00:09:06.517 { 00:09:06.517 "trtype": "RDMA", 00:09:06.517 "pending_data_buffer": 0, 00:09:06.517 "devices": [ 00:09:06.517 { 00:09:06.517 "name": "mlx5_0", 00:09:06.517 "polls": 824, 00:09:06.517 "idle_polls": 824, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 }, 00:09:06.517 { 00:09:06.517 "name": "mlx5_1", 00:09:06.517 "polls": 824, 00:09:06.517 "idle_polls": 824, 00:09:06.517 "completions": 0, 00:09:06.517 "requests": 0, 00:09:06.517 "request_latency": 0, 00:09:06.517 "pending_free_request": 0, 00:09:06.517 "pending_rdma_read": 0, 00:09:06.517 "pending_rdma_write": 0, 00:09:06.517 "pending_rdma_send": 0, 00:09:06.517 "total_send_wrs": 0, 00:09:06.517 "send_doorbell_updates": 0, 00:09:06.517 "total_recv_wrs": 4096, 00:09:06.517 "recv_doorbell_updates": 1 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 } 00:09:06.517 ] 00:09:06.517 }' 00:09:06.517 14:56:47 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:06.517 14:56:47 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:09:06.517 14:56:47 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:09:06.517 14:56:47 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:06.517 14:56:47 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:09:06.517 14:56:47 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:09:06.517 14:56:47 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:09:06.517 14:56:47 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:09:06.517 14:56:47 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:09:06.517 14:56:47 -- target/rpc.sh@15 -- # wc -l 00:09:06.779 14:56:47 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:09:06.779 14:56:47 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:09:06.779 14:56:47 -- target/rpc.sh@41 -- # transport_type=RDMA 00:09:06.779 14:56:47 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:09:06.779 14:56:47 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:09:06.779 14:56:47 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:09:06.779 14:56:47 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:09:06.779 14:56:47 -- target/rpc.sh@15 -- # wc -l 00:09:06.779 14:56:47 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:09:06.779 14:56:47 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:09:06.779 14:56:47 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:09:06.779 14:56:47 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 Malloc1 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 [2024-04-26 14:56:47.639604] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 192.168.100.8 -s 4420 00:09:06.779 14:56:47 -- common/autotest_common.sh@648 -- # local es=0 00:09:06.779 14:56:47 -- common/autotest_common.sh@650 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 192.168.100.8 -s 4420 00:09:06.779 14:56:47 -- common/autotest_common.sh@636 -- # local arg=nvme 00:09:06.779 14:56:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.779 14:56:47 -- common/autotest_common.sh@640 -- # type -t nvme 00:09:06.779 14:56:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.779 14:56:47 -- common/autotest_common.sh@642 -- # type -P nvme 00:09:06.779 14:56:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.779 14:56:47 -- common/autotest_common.sh@642 -- # arg=/usr/sbin/nvme 00:09:06.779 14:56:47 -- common/autotest_common.sh@642 -- # [[ -x /usr/sbin/nvme ]] 00:09:06.779 14:56:47 -- common/autotest_common.sh@651 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be -a 192.168.100.8 -s 4420 00:09:06.779 [2024-04-26 14:56:47.695492] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:09:06.779 Failed to write to /dev/nvme-fabrics: Input/output error 00:09:06.779 could not add new controller: failed to write to nvme-fabrics device 00:09:06.779 14:56:47 -- common/autotest_common.sh@651 -- # es=1 00:09:06.779 14:56:47 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:09:06.779 14:56:47 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:09:06.779 14:56:47 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:09:06.779 14:56:47 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:09:06.779 14:56:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.779 14:56:47 -- common/autotest_common.sh@10 -- # set +x 00:09:06.779 14:56:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.779 14:56:47 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:13.382 14:56:53 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:09:13.382 14:56:53 -- common/autotest_common.sh@1194 -- # local i=0 00:09:13.382 14:56:53 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:13.382 14:56:53 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:13.382 14:56:53 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:14.766 14:56:55 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:14.766 14:56:55 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:14.766 14:56:55 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:14.766 14:56:55 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:14.766 14:56:55 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:14.766 14:56:55 -- common/autotest_common.sh@1204 -- # return 0 00:09:14.766 14:56:55 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:18.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.973 14:56:59 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:18.973 14:56:59 -- common/autotest_common.sh@1215 -- # local i=0 00:09:18.973 14:56:59 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:18.973 14:56:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.973 14:56:59 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:18.973 14:56:59 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.973 14:56:59 -- common/autotest_common.sh@1227 -- # return 0 00:09:18.973 14:56:59 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:09:18.973 14:56:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.973 14:56:59 -- common/autotest_common.sh@10 -- # set +x 00:09:18.973 14:56:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.973 14:56:59 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:18.973 14:56:59 -- common/autotest_common.sh@648 -- # local es=0 00:09:18.973 14:56:59 -- common/autotest_common.sh@650 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:18.973 14:56:59 -- common/autotest_common.sh@636 -- # local arg=nvme 00:09:18.973 14:56:59 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:18.973 14:56:59 -- common/autotest_common.sh@640 -- # type -t nvme 00:09:18.973 14:56:59 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:18.973 14:56:59 -- common/autotest_common.sh@642 -- # type -P nvme 00:09:18.973 14:56:59 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:18.973 14:56:59 -- common/autotest_common.sh@642 -- # arg=/usr/sbin/nvme 00:09:18.973 14:56:59 -- common/autotest_common.sh@642 -- # [[ -x /usr/sbin/nvme ]] 00:09:18.973 14:56:59 -- common/autotest_common.sh@651 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:18.973 [2024-04-26 14:56:59.680291] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be' 00:09:18.973 Failed to write to /dev/nvme-fabrics: Input/output error 00:09:18.973 could not add new controller: failed to write to nvme-fabrics device 00:09:18.973 14:56:59 -- common/autotest_common.sh@651 -- # es=1 00:09:18.973 14:56:59 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:09:18.973 14:56:59 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:09:18.973 14:56:59 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:09:18.973 14:56:59 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:09:18.973 14:56:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.973 14:56:59 -- common/autotest_common.sh@10 -- # set +x 00:09:18.973 14:56:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.973 14:56:59 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:25.620 14:57:05 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:09:25.621 14:57:05 -- common/autotest_common.sh@1194 -- # local i=0 00:09:25.621 14:57:05 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:25.621 14:57:05 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:25.621 14:57:05 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:26.566 14:57:07 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:26.566 14:57:07 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:26.566 14:57:07 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:26.566 14:57:07 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:26.566 14:57:07 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:26.566 14:57:07 -- common/autotest_common.sh@1204 -- # return 0 00:09:26.566 14:57:07 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:30.773 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.773 14:57:10 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:30.773 14:57:10 -- common/autotest_common.sh@1215 -- # local i=0 00:09:30.773 14:57:10 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:30.773 14:57:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:30.773 14:57:10 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:30.773 14:57:10 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:30.773 14:57:10 -- common/autotest_common.sh@1227 -- # return 0 00:09:30.773 14:57:10 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.773 14:57:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.773 14:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:30.773 14:57:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.773 14:57:10 -- target/rpc.sh@81 -- # seq 1 5 00:09:30.773 14:57:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:30.773 14:57:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.773 14:57:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.773 14:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:30.773 14:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.773 14:57:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.773 14:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.773 14:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:30.773 [2024-04-26 14:57:11.016067] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.773 14:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.773 14:57:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:30.773 14:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.773 14:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:30.773 14:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.773 14:57:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.773 14:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.773 14:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:30.773 14:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.773 14:57:11 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:36.064 14:57:16 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:36.064 14:57:16 -- common/autotest_common.sh@1194 -- # local i=0 00:09:36.064 14:57:16 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:36.064 14:57:16 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:36.064 14:57:16 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:37.978 14:57:18 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:37.978 14:57:18 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:37.978 14:57:18 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:37.978 14:57:18 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:37.979 14:57:18 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:37.979 14:57:18 -- common/autotest_common.sh@1204 -- # return 0 00:09:37.979 14:57:18 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:41.289 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.289 14:57:21 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:41.289 14:57:21 -- common/autotest_common.sh@1215 -- # local i=0 00:09:41.289 14:57:21 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:41.289 14:57:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:41.289 14:57:21 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:41.289 14:57:21 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:41.289 14:57:21 -- common/autotest_common.sh@1227 -- # return 0 00:09:41.289 14:57:21 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:41.289 14:57:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:21 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 14:57:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:21 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:41.289 14:57:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:21 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 14:57:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:21 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:41.289 14:57:21 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:41.289 14:57:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:21 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 14:57:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:41.289 14:57:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:22 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 [2024-04-26 14:57:22.010098] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:41.289 14:57:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:41.289 14:57:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:22 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 14:57:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:41.289 14:57:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:41.289 14:57:22 -- common/autotest_common.sh@10 -- # set +x 00:09:41.289 14:57:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:41.289 14:57:22 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:47.873 14:57:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:47.873 14:57:27 -- common/autotest_common.sh@1194 -- # local i=0 00:09:47.873 14:57:27 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:47.873 14:57:27 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:47.873 14:57:27 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:48.815 14:57:29 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:48.815 14:57:29 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:48.815 14:57:29 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:48.816 14:57:29 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:48.816 14:57:29 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:48.816 14:57:29 -- common/autotest_common.sh@1204 -- # return 0 00:09:48.816 14:57:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:54.100 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.100 14:57:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:54.101 14:57:34 -- common/autotest_common.sh@1215 -- # local i=0 00:09:54.101 14:57:34 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:54.101 14:57:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:54.101 14:57:34 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:54.101 14:57:34 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:54.101 14:57:34 -- common/autotest_common.sh@1227 -- # return 0 00:09:54.101 14:57:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:54.101 14:57:34 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 [2024-04-26 14:57:34.082766] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:54.101 14:57:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:54.101 14:57:34 -- common/autotest_common.sh@10 -- # set +x 00:09:54.101 14:57:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:54.101 14:57:34 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:59.389 14:57:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:59.390 14:57:39 -- common/autotest_common.sh@1194 -- # local i=0 00:09:59.390 14:57:39 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:59.390 14:57:39 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:59.390 14:57:39 -- common/autotest_common.sh@1201 -- # sleep 2 00:10:01.302 14:57:41 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:10:01.302 14:57:41 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:10:01.302 14:57:41 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:10:01.302 14:57:41 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:10:01.302 14:57:41 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:10:01.302 14:57:41 -- common/autotest_common.sh@1204 -- # return 0 00:10:01.302 14:57:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:05.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.513 14:57:46 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:05.513 14:57:46 -- common/autotest_common.sh@1215 -- # local i=0 00:10:05.513 14:57:46 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:10:05.513 14:57:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:05.513 14:57:46 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:10:05.513 14:57:46 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:05.513 14:57:46 -- common/autotest_common.sh@1227 -- # return 0 00:10:05.513 14:57:46 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:05.513 14:57:46 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 [2024-04-26 14:57:46.208420] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:05.513 14:57:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:05.513 14:57:46 -- common/autotest_common.sh@10 -- # set +x 00:10:05.513 14:57:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:05.513 14:57:46 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:12.096 14:57:51 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:12.096 14:57:51 -- common/autotest_common.sh@1194 -- # local i=0 00:10:12.096 14:57:51 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:10:12.096 14:57:51 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:10:12.096 14:57:51 -- common/autotest_common.sh@1201 -- # sleep 2 00:10:13.037 14:57:53 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:10:13.037 14:57:53 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:10:13.037 14:57:53 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:10:13.037 14:57:53 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:10:13.037 14:57:53 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:10:13.037 14:57:53 -- common/autotest_common.sh@1204 -- # return 0 00:10:13.037 14:57:53 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:17.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.321 14:57:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:17.321 14:57:58 -- common/autotest_common.sh@1215 -- # local i=0 00:10:17.321 14:57:58 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:10:17.321 14:57:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:17.321 14:57:58 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:10:17.321 14:57:58 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:17.321 14:57:58 -- common/autotest_common.sh@1227 -- # return 0 00:10:17.321 14:57:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:17.321 14:57:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 [2024-04-26 14:57:58.135248] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:17.321 14:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:17.321 14:57:58 -- common/autotest_common.sh@10 -- # set +x 00:10:17.321 14:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:17.321 14:57:58 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:22.646 14:58:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:22.646 14:58:03 -- common/autotest_common.sh@1194 -- # local i=0 00:10:22.646 14:58:03 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:10:22.646 14:58:03 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:10:22.646 14:58:03 -- common/autotest_common.sh@1201 -- # sleep 2 00:10:25.190 14:58:05 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:10:25.190 14:58:05 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:10:25.190 14:58:05 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:10:25.190 14:58:05 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:10:25.190 14:58:05 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:10:25.190 14:58:05 -- common/autotest_common.sh@1204 -- # return 0 00:10:25.190 14:58:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:29.402 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.402 14:58:09 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:29.402 14:58:09 -- common/autotest_common.sh@1215 -- # local i=0 00:10:29.402 14:58:09 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:10:29.402 14:58:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:29.402 14:58:09 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:10:29.402 14:58:09 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:29.402 14:58:09 -- common/autotest_common.sh@1227 -- # return 0 00:10:29.402 14:58:09 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@99 -- # seq 1 5 00:10:29.402 14:58:09 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:10:29.402 14:58:09 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 [2024-04-26 14:58:09.965801] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:09 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.402 14:58:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:09 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:10:29.402 14:58:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 [2024-04-26 14:58:10.030322] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.402 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.402 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.402 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.402 14:58:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:10:29.403 14:58:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 [2024-04-26 14:58:10.086701] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:10:29.403 14:58:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 [2024-04-26 14:58:10.146905] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:10:29.403 14:58:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 [2024-04-26 14:58:10.207124] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:10:29.403 14:58:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:29.403 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.403 14:58:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:29.403 14:58:10 -- target/rpc.sh@110 -- # stats='{ 00:10:29.403 "tick_rate": 2400000000, 00:10:29.403 "poll_groups": [ 00:10:29.403 { 00:10:29.403 "name": "nvmf_tgt_poll_group_0", 00:10:29.403 "admin_qpairs": 2, 00:10:29.403 "io_qpairs": 27, 00:10:29.403 "current_admin_qpairs": 0, 00:10:29.403 "current_io_qpairs": 0, 00:10:29.403 "pending_bdev_io": 0, 00:10:29.403 "completed_nvme_io": 78, 00:10:29.403 "transports": [ 00:10:29.403 { 00:10:29.403 "trtype": "RDMA", 00:10:29.403 "pending_data_buffer": 0, 00:10:29.403 "devices": [ 00:10:29.403 { 00:10:29.403 "name": "mlx5_0", 00:10:29.403 "polls": 8983335, 00:10:29.403 "idle_polls": 8983066, 00:10:29.403 "completions": 289, 00:10:29.403 "requests": 144, 00:10:29.403 "request_latency": 25611112, 00:10:29.403 "pending_free_request": 0, 00:10:29.403 "pending_rdma_read": 0, 00:10:29.403 "pending_rdma_write": 0, 00:10:29.403 "pending_rdma_send": 0, 00:10:29.403 "total_send_wrs": 229, 00:10:29.403 "send_doorbell_updates": 133, 00:10:29.403 "total_recv_wrs": 4240, 00:10:29.403 "recv_doorbell_updates": 133 00:10:29.403 }, 00:10:29.403 { 00:10:29.403 "name": "mlx5_1", 00:10:29.403 "polls": 8983335, 00:10:29.403 "idle_polls": 8983335, 00:10:29.403 "completions": 0, 00:10:29.403 "requests": 0, 00:10:29.403 "request_latency": 0, 00:10:29.403 "pending_free_request": 0, 00:10:29.403 "pending_rdma_read": 0, 00:10:29.403 "pending_rdma_write": 0, 00:10:29.403 "pending_rdma_send": 0, 00:10:29.403 "total_send_wrs": 0, 00:10:29.403 "send_doorbell_updates": 0, 00:10:29.403 "total_recv_wrs": 4096, 00:10:29.403 "recv_doorbell_updates": 1 00:10:29.403 } 00:10:29.403 ] 00:10:29.403 } 00:10:29.403 ] 00:10:29.403 }, 00:10:29.403 { 00:10:29.403 "name": "nvmf_tgt_poll_group_1", 00:10:29.403 "admin_qpairs": 2, 00:10:29.403 "io_qpairs": 26, 00:10:29.403 "current_admin_qpairs": 0, 00:10:29.403 "current_io_qpairs": 0, 00:10:29.403 "pending_bdev_io": 0, 00:10:29.403 "completed_nvme_io": 175, 00:10:29.403 "transports": [ 00:10:29.403 { 00:10:29.403 "trtype": "RDMA", 00:10:29.403 "pending_data_buffer": 0, 00:10:29.403 "devices": [ 00:10:29.403 { 00:10:29.403 "name": "mlx5_0", 00:10:29.403 "polls": 13838103, 00:10:29.403 "idle_polls": 13837684, 00:10:29.403 "completions": 480, 00:10:29.403 "requests": 240, 00:10:29.403 "request_latency": 41458196, 00:10:29.403 "pending_free_request": 0, 00:10:29.403 "pending_rdma_read": 0, 00:10:29.403 "pending_rdma_write": 0, 00:10:29.403 "pending_rdma_send": 0, 00:10:29.403 "total_send_wrs": 422, 00:10:29.403 "send_doorbell_updates": 203, 00:10:29.403 "total_recv_wrs": 4336, 00:10:29.403 "recv_doorbell_updates": 204 00:10:29.403 }, 00:10:29.403 { 00:10:29.403 "name": "mlx5_1", 00:10:29.403 "polls": 13838103, 00:10:29.403 "idle_polls": 13838103, 00:10:29.403 "completions": 0, 00:10:29.403 "requests": 0, 00:10:29.403 "request_latency": 0, 00:10:29.403 "pending_free_request": 0, 00:10:29.403 "pending_rdma_read": 0, 00:10:29.403 "pending_rdma_write": 0, 00:10:29.403 "pending_rdma_send": 0, 00:10:29.403 "total_send_wrs": 0, 00:10:29.403 "send_doorbell_updates": 0, 00:10:29.403 "total_recv_wrs": 4096, 00:10:29.403 "recv_doorbell_updates": 1 00:10:29.403 } 00:10:29.403 ] 00:10:29.403 } 00:10:29.403 ] 00:10:29.403 }, 00:10:29.403 { 00:10:29.403 "name": "nvmf_tgt_poll_group_2", 00:10:29.403 "admin_qpairs": 1, 00:10:29.404 "io_qpairs": 26, 00:10:29.404 "current_admin_qpairs": 0, 00:10:29.404 "current_io_qpairs": 0, 00:10:29.404 "pending_bdev_io": 0, 00:10:29.404 "completed_nvme_io": 82, 00:10:29.404 "transports": [ 00:10:29.404 { 00:10:29.404 "trtype": "RDMA", 00:10:29.404 "pending_data_buffer": 0, 00:10:29.404 "devices": [ 00:10:29.404 { 00:10:29.404 "name": "mlx5_0", 00:10:29.404 "polls": 8771474, 00:10:29.404 "idle_polls": 8771270, 00:10:29.404 "completions": 233, 00:10:29.404 "requests": 116, 00:10:29.404 "request_latency": 25907876, 00:10:29.404 "pending_free_request": 0, 00:10:29.404 "pending_rdma_read": 0, 00:10:29.404 "pending_rdma_write": 0, 00:10:29.404 "pending_rdma_send": 0, 00:10:29.404 "total_send_wrs": 190, 00:10:29.404 "send_doorbell_updates": 101, 00:10:29.404 "total_recv_wrs": 4212, 00:10:29.404 "recv_doorbell_updates": 101 00:10:29.404 }, 00:10:29.404 { 00:10:29.404 "name": "mlx5_1", 00:10:29.404 "polls": 8771474, 00:10:29.404 "idle_polls": 8771474, 00:10:29.404 "completions": 0, 00:10:29.404 "requests": 0, 00:10:29.404 "request_latency": 0, 00:10:29.404 "pending_free_request": 0, 00:10:29.404 "pending_rdma_read": 0, 00:10:29.404 "pending_rdma_write": 0, 00:10:29.404 "pending_rdma_send": 0, 00:10:29.404 "total_send_wrs": 0, 00:10:29.404 "send_doorbell_updates": 0, 00:10:29.404 "total_recv_wrs": 4096, 00:10:29.404 "recv_doorbell_updates": 1 00:10:29.404 } 00:10:29.404 ] 00:10:29.404 } 00:10:29.404 ] 00:10:29.404 }, 00:10:29.404 { 00:10:29.404 "name": "nvmf_tgt_poll_group_3", 00:10:29.404 "admin_qpairs": 2, 00:10:29.404 "io_qpairs": 26, 00:10:29.404 "current_admin_qpairs": 0, 00:10:29.404 "current_io_qpairs": 0, 00:10:29.404 "pending_bdev_io": 0, 00:10:29.404 "completed_nvme_io": 120, 00:10:29.404 "transports": [ 00:10:29.404 { 00:10:29.404 "trtype": "RDMA", 00:10:29.404 "pending_data_buffer": 0, 00:10:29.404 "devices": [ 00:10:29.404 { 00:10:29.404 "name": "mlx5_0", 00:10:29.404 "polls": 7408900, 00:10:29.404 "idle_polls": 7408567, 00:10:29.404 "completions": 372, 00:10:29.404 "requests": 186, 00:10:29.404 "request_latency": 39677896, 00:10:29.404 "pending_free_request": 0, 00:10:29.404 "pending_rdma_read": 0, 00:10:29.404 "pending_rdma_write": 0, 00:10:29.404 "pending_rdma_send": 0, 00:10:29.404 "total_send_wrs": 313, 00:10:29.404 "send_doorbell_updates": 163, 00:10:29.404 "total_recv_wrs": 4282, 00:10:29.404 "recv_doorbell_updates": 164 00:10:29.404 }, 00:10:29.404 { 00:10:29.404 "name": "mlx5_1", 00:10:29.404 "polls": 7408900, 00:10:29.404 "idle_polls": 7408900, 00:10:29.404 "completions": 0, 00:10:29.404 "requests": 0, 00:10:29.404 "request_latency": 0, 00:10:29.404 "pending_free_request": 0, 00:10:29.404 "pending_rdma_read": 0, 00:10:29.404 "pending_rdma_write": 0, 00:10:29.404 "pending_rdma_send": 0, 00:10:29.404 "total_send_wrs": 0, 00:10:29.404 "send_doorbell_updates": 0, 00:10:29.404 "total_recv_wrs": 4096, 00:10:29.404 "recv_doorbell_updates": 1 00:10:29.404 } 00:10:29.404 ] 00:10:29.404 } 00:10:29.404 ] 00:10:29.404 } 00:10:29.404 ] 00:10:29.404 }' 00:10:29.404 14:58:10 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:29.404 14:58:10 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:10:29.404 14:58:10 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:10:29.404 14:58:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:29.664 14:58:10 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:10:29.664 14:58:10 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:10:29.664 14:58:10 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:10:29.664 14:58:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:10:29.664 14:58:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:10:29.664 14:58:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:29.664 14:58:10 -- target/rpc.sh@117 -- # (( 1374 > 0 )) 00:10:29.664 14:58:10 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:10:29.664 14:58:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:10:29.664 14:58:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:10:29.664 14:58:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:29.664 14:58:10 -- target/rpc.sh@118 -- # (( 132655080 > 0 )) 00:10:29.664 14:58:10 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:10:29.664 14:58:10 -- target/rpc.sh@123 -- # nvmftestfini 00:10:29.664 14:58:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:29.664 14:58:10 -- nvmf/common.sh@117 -- # sync 00:10:29.664 14:58:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:29.664 14:58:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:29.664 14:58:10 -- nvmf/common.sh@120 -- # set +e 00:10:29.664 14:58:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:29.664 14:58:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:29.664 rmmod nvme_rdma 00:10:29.664 rmmod nvme_fabrics 00:10:29.664 14:58:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:29.664 14:58:10 -- nvmf/common.sh@124 -- # set -e 00:10:29.664 14:58:10 -- nvmf/common.sh@125 -- # return 0 00:10:29.664 14:58:10 -- nvmf/common.sh@478 -- # '[' -n 3382084 ']' 00:10:29.664 14:58:10 -- nvmf/common.sh@479 -- # killprocess 3382084 00:10:29.664 14:58:10 -- common/autotest_common.sh@946 -- # '[' -z 3382084 ']' 00:10:29.664 14:58:10 -- common/autotest_common.sh@950 -- # kill -0 3382084 00:10:29.664 14:58:10 -- common/autotest_common.sh@951 -- # uname 00:10:29.664 14:58:10 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:10:29.664 14:58:10 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3382084 00:10:29.664 14:58:10 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:10:29.664 14:58:10 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:10:29.664 14:58:10 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3382084' 00:10:29.664 killing process with pid 3382084 00:10:29.664 14:58:10 -- common/autotest_common.sh@965 -- # kill 3382084 00:10:29.664 14:58:10 -- common/autotest_common.sh@970 -- # wait 3382084 00:10:29.925 [2024-04-26 14:58:10.642115] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:29.925 14:58:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:29.925 14:58:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:29.925 00:10:29.925 real 1m31.673s 00:10:29.925 user 5m39.405s 00:10:29.925 sys 0m7.296s 00:10:29.925 14:58:10 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:10:29.925 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:29.925 ************************************ 00:10:29.925 END TEST nvmf_rpc 00:10:29.925 ************************************ 00:10:29.925 14:58:10 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:10:29.925 14:58:10 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:10:29.925 14:58:10 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:10:29.925 14:58:10 -- common/autotest_common.sh@10 -- # set +x 00:10:30.186 ************************************ 00:10:30.186 START TEST nvmf_invalid 00:10:30.186 ************************************ 00:10:30.186 14:58:10 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:10:30.186 * Looking for test storage... 00:10:30.186 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:30.186 14:58:11 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:30.186 14:58:11 -- nvmf/common.sh@7 -- # uname -s 00:10:30.186 14:58:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:30.186 14:58:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:30.186 14:58:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:30.186 14:58:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:30.186 14:58:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:30.186 14:58:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:30.186 14:58:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:30.186 14:58:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:30.186 14:58:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:30.186 14:58:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:30.186 14:58:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:30.186 14:58:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:30.186 14:58:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:30.186 14:58:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:30.186 14:58:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:30.186 14:58:11 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:30.186 14:58:11 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:30.186 14:58:11 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:30.186 14:58:11 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:30.186 14:58:11 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:30.186 14:58:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:30.186 14:58:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:30.186 14:58:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:30.186 14:58:11 -- paths/export.sh@5 -- # export PATH 00:10:30.186 14:58:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:30.186 14:58:11 -- nvmf/common.sh@47 -- # : 0 00:10:30.186 14:58:11 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:30.186 14:58:11 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:30.186 14:58:11 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:30.186 14:58:11 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:30.186 14:58:11 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:30.186 14:58:11 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:30.186 14:58:11 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:30.186 14:58:11 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:30.186 14:58:11 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:10:30.186 14:58:11 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:30.186 14:58:11 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:10:30.186 14:58:11 -- target/invalid.sh@14 -- # target=foobar 00:10:30.186 14:58:11 -- target/invalid.sh@16 -- # RANDOM=0 00:10:30.186 14:58:11 -- target/invalid.sh@34 -- # nvmftestinit 00:10:30.186 14:58:11 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:30.186 14:58:11 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:30.186 14:58:11 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:30.186 14:58:11 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:30.186 14:58:11 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:30.186 14:58:11 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:30.186 14:58:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:30.186 14:58:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:30.186 14:58:11 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:30.186 14:58:11 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:30.447 14:58:11 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:30.447 14:58:11 -- common/autotest_common.sh@10 -- # set +x 00:10:37.044 14:58:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:37.044 14:58:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:37.044 14:58:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:37.044 14:58:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:37.044 14:58:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:37.044 14:58:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:37.044 14:58:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:37.044 14:58:17 -- nvmf/common.sh@295 -- # net_devs=() 00:10:37.044 14:58:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:37.044 14:58:17 -- nvmf/common.sh@296 -- # e810=() 00:10:37.044 14:58:17 -- nvmf/common.sh@296 -- # local -ga e810 00:10:37.044 14:58:17 -- nvmf/common.sh@297 -- # x722=() 00:10:37.044 14:58:17 -- nvmf/common.sh@297 -- # local -ga x722 00:10:37.044 14:58:17 -- nvmf/common.sh@298 -- # mlx=() 00:10:37.044 14:58:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:37.044 14:58:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:37.044 14:58:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:37.044 14:58:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:37.044 14:58:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:37.044 14:58:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:37.044 14:58:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:37.044 14:58:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:37.045 14:58:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:10:37.045 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:10:37.045 14:58:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:37.045 14:58:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:10:37.045 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:10:37.045 14:58:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:37.045 14:58:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:37.045 14:58:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:37.045 14:58:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:10:37.045 Found net devices under 0000:31:00.0: mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:37.045 14:58:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:37.045 14:58:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:37.045 14:58:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:10:37.045 Found net devices under 0000:31:00.1: mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:37.045 14:58:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:37.045 14:58:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:37.045 14:58:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:37.045 14:58:17 -- nvmf/common.sh@58 -- # uname 00:10:37.045 14:58:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:37.045 14:58:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:37.045 14:58:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:37.045 14:58:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:37.045 14:58:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:37.045 14:58:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:37.045 14:58:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:37.045 14:58:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:37.045 14:58:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:37.045 14:58:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:37.045 14:58:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:37.045 14:58:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:37.045 14:58:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:37.045 14:58:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:37.045 14:58:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:37.045 14:58:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@105 -- # continue 2 00:10:37.045 14:58:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@105 -- # continue 2 00:10:37.045 14:58:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:37.045 14:58:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:37.045 14:58:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:37.045 14:58:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:37.045 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:37.045 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:10:37.045 altname enp49s0f0np0 00:10:37.045 altname ens786f0np0 00:10:37.045 inet 192.168.100.8/24 scope global mlx_0_0 00:10:37.045 valid_lft forever preferred_lft forever 00:10:37.045 14:58:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:37.045 14:58:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:37.045 14:58:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:37.045 14:58:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:37.045 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:37.045 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:10:37.045 altname enp49s0f1np1 00:10:37.045 altname ens786f1np1 00:10:37.045 inet 192.168.100.9/24 scope global mlx_0_1 00:10:37.045 valid_lft forever preferred_lft forever 00:10:37.045 14:58:17 -- nvmf/common.sh@411 -- # return 0 00:10:37.045 14:58:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:37.045 14:58:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:37.045 14:58:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:37.045 14:58:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:37.045 14:58:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:37.045 14:58:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:37.045 14:58:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:37.045 14:58:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:37.045 14:58:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:37.045 14:58:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@105 -- # continue 2 00:10:37.045 14:58:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:37.045 14:58:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:37.045 14:58:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@105 -- # continue 2 00:10:37.045 14:58:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:37.045 14:58:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:37.045 14:58:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:37.045 14:58:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:37.045 14:58:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:37.045 14:58:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:37.045 192.168.100.9' 00:10:37.045 14:58:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:37.045 192.168.100.9' 00:10:37.045 14:58:17 -- nvmf/common.sh@446 -- # head -n 1 00:10:37.045 14:58:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:37.045 14:58:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:37.045 192.168.100.9' 00:10:37.045 14:58:17 -- nvmf/common.sh@447 -- # tail -n +2 00:10:37.045 14:58:17 -- nvmf/common.sh@447 -- # head -n 1 00:10:37.045 14:58:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:37.045 14:58:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:37.045 14:58:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:37.045 14:58:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:37.045 14:58:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:37.045 14:58:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:37.045 14:58:17 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:10:37.045 14:58:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:37.045 14:58:17 -- common/autotest_common.sh@720 -- # xtrace_disable 00:10:37.045 14:58:17 -- common/autotest_common.sh@10 -- # set +x 00:10:37.045 14:58:17 -- nvmf/common.sh@470 -- # nvmfpid=3403130 00:10:37.045 14:58:17 -- nvmf/common.sh@471 -- # waitforlisten 3403130 00:10:37.045 14:58:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:37.045 14:58:17 -- common/autotest_common.sh@827 -- # '[' -z 3403130 ']' 00:10:37.046 14:58:17 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:37.046 14:58:17 -- common/autotest_common.sh@832 -- # local max_retries=100 00:10:37.046 14:58:17 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:37.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:37.046 14:58:17 -- common/autotest_common.sh@836 -- # xtrace_disable 00:10:37.046 14:58:17 -- common/autotest_common.sh@10 -- # set +x 00:10:37.046 [2024-04-26 14:58:17.980732] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:10:37.046 [2024-04-26 14:58:17.980787] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:37.316 EAL: No free 2048 kB hugepages reported on node 1 00:10:37.316 [2024-04-26 14:58:18.042334] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:37.316 [2024-04-26 14:58:18.107243] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:37.316 [2024-04-26 14:58:18.107291] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:37.316 [2024-04-26 14:58:18.107300] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:37.316 [2024-04-26 14:58:18.107309] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:37.316 [2024-04-26 14:58:18.107316] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:37.316 [2024-04-26 14:58:18.107405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:37.316 [2024-04-26 14:58:18.107541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:37.316 [2024-04-26 14:58:18.107668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:37.316 [2024-04-26 14:58:18.107671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:37.888 14:58:18 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:10:37.888 14:58:18 -- common/autotest_common.sh@860 -- # return 0 00:10:37.888 14:58:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:37.888 14:58:18 -- common/autotest_common.sh@726 -- # xtrace_disable 00:10:37.888 14:58:18 -- common/autotest_common.sh@10 -- # set +x 00:10:37.888 14:58:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:37.888 14:58:18 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:10:37.888 14:58:18 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode25767 00:10:38.149 [2024-04-26 14:58:18.934231] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:10:38.149 14:58:18 -- target/invalid.sh@40 -- # out='request: 00:10:38.149 { 00:10:38.149 "nqn": "nqn.2016-06.io.spdk:cnode25767", 00:10:38.149 "tgt_name": "foobar", 00:10:38.149 "method": "nvmf_create_subsystem", 00:10:38.149 "req_id": 1 00:10:38.149 } 00:10:38.149 Got JSON-RPC error response 00:10:38.149 response: 00:10:38.149 { 00:10:38.149 "code": -32603, 00:10:38.149 "message": "Unable to find target foobar" 00:10:38.149 }' 00:10:38.149 14:58:18 -- target/invalid.sh@41 -- # [[ request: 00:10:38.149 { 00:10:38.149 "nqn": "nqn.2016-06.io.spdk:cnode25767", 00:10:38.149 "tgt_name": "foobar", 00:10:38.149 "method": "nvmf_create_subsystem", 00:10:38.149 "req_id": 1 00:10:38.149 } 00:10:38.149 Got JSON-RPC error response 00:10:38.149 response: 00:10:38.149 { 00:10:38.149 "code": -32603, 00:10:38.149 "message": "Unable to find target foobar" 00:10:38.149 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:10:38.149 14:58:18 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:10:38.149 14:58:18 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode14896 00:10:38.411 [2024-04-26 14:58:19.110837] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14896: invalid serial number 'SPDKISFASTANDAWESOME' 00:10:38.411 14:58:19 -- target/invalid.sh@45 -- # out='request: 00:10:38.411 { 00:10:38.411 "nqn": "nqn.2016-06.io.spdk:cnode14896", 00:10:38.411 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:10:38.411 "method": "nvmf_create_subsystem", 00:10:38.411 "req_id": 1 00:10:38.411 } 00:10:38.411 Got JSON-RPC error response 00:10:38.411 response: 00:10:38.411 { 00:10:38.411 "code": -32602, 00:10:38.411 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:10:38.411 }' 00:10:38.411 14:58:19 -- target/invalid.sh@46 -- # [[ request: 00:10:38.411 { 00:10:38.411 "nqn": "nqn.2016-06.io.spdk:cnode14896", 00:10:38.411 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:10:38.411 "method": "nvmf_create_subsystem", 00:10:38.411 "req_id": 1 00:10:38.411 } 00:10:38.411 Got JSON-RPC error response 00:10:38.411 response: 00:10:38.411 { 00:10:38.411 "code": -32602, 00:10:38.411 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:10:38.411 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:10:38.411 14:58:19 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:10:38.411 14:58:19 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode28732 00:10:38.411 [2024-04-26 14:58:19.279400] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28732: invalid model number 'SPDK_Controller' 00:10:38.411 14:58:19 -- target/invalid.sh@50 -- # out='request: 00:10:38.411 { 00:10:38.411 "nqn": "nqn.2016-06.io.spdk:cnode28732", 00:10:38.411 "model_number": "SPDK_Controller\u001f", 00:10:38.411 "method": "nvmf_create_subsystem", 00:10:38.411 "req_id": 1 00:10:38.411 } 00:10:38.411 Got JSON-RPC error response 00:10:38.411 response: 00:10:38.411 { 00:10:38.411 "code": -32602, 00:10:38.411 "message": "Invalid MN SPDK_Controller\u001f" 00:10:38.411 }' 00:10:38.411 14:58:19 -- target/invalid.sh@51 -- # [[ request: 00:10:38.411 { 00:10:38.411 "nqn": "nqn.2016-06.io.spdk:cnode28732", 00:10:38.411 "model_number": "SPDK_Controller\u001f", 00:10:38.411 "method": "nvmf_create_subsystem", 00:10:38.411 "req_id": 1 00:10:38.411 } 00:10:38.411 Got JSON-RPC error response 00:10:38.411 response: 00:10:38.411 { 00:10:38.411 "code": -32602, 00:10:38.411 "message": "Invalid MN SPDK_Controller\u001f" 00:10:38.411 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:10:38.411 14:58:19 -- target/invalid.sh@54 -- # gen_random_s 21 00:10:38.411 14:58:19 -- target/invalid.sh@19 -- # local length=21 ll 00:10:38.411 14:58:19 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:10:38.411 14:58:19 -- target/invalid.sh@21 -- # local chars 00:10:38.411 14:58:19 -- target/invalid.sh@22 -- # local string 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 66 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x42' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+=B 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 81 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x51' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+=Q 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 127 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+=$'\177' 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 96 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x60' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+='`' 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 49 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x31' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+=1 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # printf %x 62 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:10:38.411 14:58:19 -- target/invalid.sh@25 -- # string+='>' 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.411 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 75 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=K 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 113 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x71' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=q 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 88 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x58' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=X 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 52 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x34' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=4 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 114 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x72' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=r 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 67 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x43' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=C 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 103 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x67' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=g 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 37 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x25' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=% 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 108 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=l 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 75 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=K 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 84 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x54' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=T 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 88 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x58' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=X 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 51 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x33' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=3 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 88 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x58' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=X 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # printf %x 97 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x61' 00:10:38.673 14:58:19 -- target/invalid.sh@25 -- # string+=a 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.673 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.673 14:58:19 -- target/invalid.sh@28 -- # [[ B == \- ]] 00:10:38.673 14:58:19 -- target/invalid.sh@31 -- # echo 'BQ`1>KqX4rCg%lKTX3Xa' 00:10:38.673 14:58:19 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'BQ`1>KqX4rCg%lKTX3Xa' nqn.2016-06.io.spdk:cnode29276 00:10:38.673 [2024-04-26 14:58:19.612426] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29276: invalid serial number 'BQ`1>KqX4rCg%lKTX3Xa' 00:10:38.935 14:58:19 -- target/invalid.sh@54 -- # out='request: 00:10:38.935 { 00:10:38.935 "nqn": "nqn.2016-06.io.spdk:cnode29276", 00:10:38.935 "serial_number": "BQ\u007f`1>KqX4rCg%lKTX3Xa", 00:10:38.935 "method": "nvmf_create_subsystem", 00:10:38.935 "req_id": 1 00:10:38.935 } 00:10:38.935 Got JSON-RPC error response 00:10:38.935 response: 00:10:38.935 { 00:10:38.935 "code": -32602, 00:10:38.935 "message": "Invalid SN BQ\u007f`1>KqX4rCg%lKTX3Xa" 00:10:38.935 }' 00:10:38.935 14:58:19 -- target/invalid.sh@55 -- # [[ request: 00:10:38.935 { 00:10:38.935 "nqn": "nqn.2016-06.io.spdk:cnode29276", 00:10:38.935 "serial_number": "BQ\u007f`1>KqX4rCg%lKTX3Xa", 00:10:38.935 "method": "nvmf_create_subsystem", 00:10:38.935 "req_id": 1 00:10:38.935 } 00:10:38.935 Got JSON-RPC error response 00:10:38.935 response: 00:10:38.935 { 00:10:38.935 "code": -32602, 00:10:38.935 "message": "Invalid SN BQ\u007f`1>KqX4rCg%lKTX3Xa" 00:10:38.935 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:10:38.935 14:58:19 -- target/invalid.sh@58 -- # gen_random_s 41 00:10:38.935 14:58:19 -- target/invalid.sh@19 -- # local length=41 ll 00:10:38.935 14:58:19 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:10:38.935 14:58:19 -- target/invalid.sh@21 -- # local chars 00:10:38.935 14:58:19 -- target/invalid.sh@22 -- # local string 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 62 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+='>' 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 79 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=O 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 117 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x75' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=u 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 99 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x63' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=c 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 114 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x72' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=r 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 83 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x53' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=S 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 73 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x49' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=I 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 65 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x41' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=A 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 127 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=$'\177' 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 127 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=$'\177' 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 46 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=. 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 117 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x75' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=u 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 35 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x23' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+='#' 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 88 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x58' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=X 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 49 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x31' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+=1 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # printf %x 33 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x21' 00:10:38.935 14:58:19 -- target/invalid.sh@25 -- # string+='!' 00:10:38.935 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 107 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=k 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 39 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x27' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=\' 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 108 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=l 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 62 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+='>' 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 108 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=l 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 86 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x56' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=V 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 71 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x47' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=G 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 74 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=J 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 34 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x22' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+='"' 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 57 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x39' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=9 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 101 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x65' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=e 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 123 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+='{' 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 100 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x64' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=d 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 106 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=j 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 53 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x35' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=5 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # printf %x 89 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x59' 00:10:38.936 14:58:19 -- target/invalid.sh@25 -- # string+=Y 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:38.936 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 52 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x34' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+=4 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 95 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+=_ 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 38 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x26' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+='&' 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 69 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x45' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+=E 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 61 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+== 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 90 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+=Z 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.196 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # printf %x 33 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x21' 00:10:39.196 14:58:19 -- target/invalid.sh@25 -- # string+='!' 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # printf %x 49 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x31' 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # string+=1 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # printf %x 54 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # echo -e '\x36' 00:10:39.197 14:58:19 -- target/invalid.sh@25 -- # string+=6 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll++ )) 00:10:39.197 14:58:19 -- target/invalid.sh@24 -- # (( ll < length )) 00:10:39.197 14:58:19 -- target/invalid.sh@28 -- # [[ > == \- ]] 00:10:39.197 14:58:19 -- target/invalid.sh@31 -- # echo '>OucrSIA.u#X1!k'\''l>lVGJ"9e{dj5Y4_&E=Z!16' 00:10:39.197 14:58:19 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '>OucrSIA.u#X1!k'\''l>lVGJ"9e{dj5Y4_&E=Z!16' nqn.2016-06.io.spdk:cnode22042 00:10:39.197 [2024-04-26 14:58:20.090033] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22042: invalid model number '>OucrSIA.u#X1!k'l>lVGJ"9e{dj5Y4_&E=Z!16' 00:10:39.197 14:58:20 -- target/invalid.sh@58 -- # out='request: 00:10:39.197 { 00:10:39.197 "nqn": "nqn.2016-06.io.spdk:cnode22042", 00:10:39.197 "model_number": ">OucrSIA\u007f\u007f.u#X1!k'\''l>lVGJ\"9e{dj5Y4_&E=Z!16", 00:10:39.197 "method": "nvmf_create_subsystem", 00:10:39.197 "req_id": 1 00:10:39.197 } 00:10:39.197 Got JSON-RPC error response 00:10:39.197 response: 00:10:39.197 { 00:10:39.197 "code": -32602, 00:10:39.197 "message": "Invalid MN >OucrSIA\u007f\u007f.u#X1!k'\''l>lVGJ\"9e{dj5Y4_&E=Z!16" 00:10:39.197 }' 00:10:39.197 14:58:20 -- target/invalid.sh@59 -- # [[ request: 00:10:39.197 { 00:10:39.197 "nqn": "nqn.2016-06.io.spdk:cnode22042", 00:10:39.197 "model_number": ">OucrSIA\u007f\u007f.u#X1!k'l>lVGJ\"9e{dj5Y4_&E=Z!16", 00:10:39.197 "method": "nvmf_create_subsystem", 00:10:39.197 "req_id": 1 00:10:39.197 } 00:10:39.197 Got JSON-RPC error response 00:10:39.197 response: 00:10:39.197 { 00:10:39.197 "code": -32602, 00:10:39.197 "message": "Invalid MN >OucrSIA\u007f\u007f.u#X1!k'l>lVGJ\"9e{dj5Y4_&E=Z!16" 00:10:39.197 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:10:39.197 14:58:20 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:10:39.457 [2024-04-26 14:58:20.292177] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x548160/0x54c650) succeed. 00:10:39.457 [2024-04-26 14:58:20.305223] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x5497a0/0x58dce0) succeed. 00:10:39.718 14:58:20 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:10:39.718 14:58:20 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:10:39.718 14:58:20 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:10:39.718 192.168.100.9' 00:10:39.718 14:58:20 -- target/invalid.sh@67 -- # head -n 1 00:10:39.718 14:58:20 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:10:39.718 14:58:20 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:10:39.979 [2024-04-26 14:58:20.768777] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:10:39.979 14:58:20 -- target/invalid.sh@69 -- # out='request: 00:10:39.979 { 00:10:39.979 "nqn": "nqn.2016-06.io.spdk:cnode", 00:10:39.979 "listen_address": { 00:10:39.979 "trtype": "rdma", 00:10:39.979 "traddr": "192.168.100.8", 00:10:39.979 "trsvcid": "4421" 00:10:39.979 }, 00:10:39.979 "method": "nvmf_subsystem_remove_listener", 00:10:39.979 "req_id": 1 00:10:39.979 } 00:10:39.979 Got JSON-RPC error response 00:10:39.979 response: 00:10:39.979 { 00:10:39.979 "code": -32602, 00:10:39.979 "message": "Invalid parameters" 00:10:39.979 }' 00:10:39.979 14:58:20 -- target/invalid.sh@70 -- # [[ request: 00:10:39.979 { 00:10:39.979 "nqn": "nqn.2016-06.io.spdk:cnode", 00:10:39.979 "listen_address": { 00:10:39.979 "trtype": "rdma", 00:10:39.979 "traddr": "192.168.100.8", 00:10:39.979 "trsvcid": "4421" 00:10:39.979 }, 00:10:39.979 "method": "nvmf_subsystem_remove_listener", 00:10:39.979 "req_id": 1 00:10:39.979 } 00:10:39.979 Got JSON-RPC error response 00:10:39.979 response: 00:10:39.979 { 00:10:39.979 "code": -32602, 00:10:39.979 "message": "Invalid parameters" 00:10:39.979 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:10:39.979 14:58:20 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16922 -i 0 00:10:40.241 [2024-04-26 14:58:20.941359] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16922: invalid cntlid range [0-65519] 00:10:40.241 14:58:20 -- target/invalid.sh@73 -- # out='request: 00:10:40.241 { 00:10:40.241 "nqn": "nqn.2016-06.io.spdk:cnode16922", 00:10:40.241 "min_cntlid": 0, 00:10:40.241 "method": "nvmf_create_subsystem", 00:10:40.241 "req_id": 1 00:10:40.241 } 00:10:40.241 Got JSON-RPC error response 00:10:40.241 response: 00:10:40.241 { 00:10:40.241 "code": -32602, 00:10:40.241 "message": "Invalid cntlid range [0-65519]" 00:10:40.241 }' 00:10:40.241 14:58:20 -- target/invalid.sh@74 -- # [[ request: 00:10:40.241 { 00:10:40.241 "nqn": "nqn.2016-06.io.spdk:cnode16922", 00:10:40.241 "min_cntlid": 0, 00:10:40.241 "method": "nvmf_create_subsystem", 00:10:40.241 "req_id": 1 00:10:40.241 } 00:10:40.241 Got JSON-RPC error response 00:10:40.241 response: 00:10:40.241 { 00:10:40.241 "code": -32602, 00:10:40.241 "message": "Invalid cntlid range [0-65519]" 00:10:40.241 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:10:40.241 14:58:20 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24962 -i 65520 00:10:40.241 [2024-04-26 14:58:21.113977] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24962: invalid cntlid range [65520-65519] 00:10:40.241 14:58:21 -- target/invalid.sh@75 -- # out='request: 00:10:40.241 { 00:10:40.241 "nqn": "nqn.2016-06.io.spdk:cnode24962", 00:10:40.241 "min_cntlid": 65520, 00:10:40.241 "method": "nvmf_create_subsystem", 00:10:40.241 "req_id": 1 00:10:40.241 } 00:10:40.241 Got JSON-RPC error response 00:10:40.241 response: 00:10:40.241 { 00:10:40.241 "code": -32602, 00:10:40.241 "message": "Invalid cntlid range [65520-65519]" 00:10:40.241 }' 00:10:40.241 14:58:21 -- target/invalid.sh@76 -- # [[ request: 00:10:40.241 { 00:10:40.241 "nqn": "nqn.2016-06.io.spdk:cnode24962", 00:10:40.241 "min_cntlid": 65520, 00:10:40.241 "method": "nvmf_create_subsystem", 00:10:40.241 "req_id": 1 00:10:40.241 } 00:10:40.241 Got JSON-RPC error response 00:10:40.241 response: 00:10:40.241 { 00:10:40.241 "code": -32602, 00:10:40.241 "message": "Invalid cntlid range [65520-65519]" 00:10:40.241 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:10:40.241 14:58:21 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5619 -I 0 00:10:40.502 [2024-04-26 14:58:21.282602] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5619: invalid cntlid range [1-0] 00:10:40.502 14:58:21 -- target/invalid.sh@77 -- # out='request: 00:10:40.502 { 00:10:40.502 "nqn": "nqn.2016-06.io.spdk:cnode5619", 00:10:40.502 "max_cntlid": 0, 00:10:40.502 "method": "nvmf_create_subsystem", 00:10:40.502 "req_id": 1 00:10:40.502 } 00:10:40.502 Got JSON-RPC error response 00:10:40.502 response: 00:10:40.502 { 00:10:40.502 "code": -32602, 00:10:40.502 "message": "Invalid cntlid range [1-0]" 00:10:40.502 }' 00:10:40.502 14:58:21 -- target/invalid.sh@78 -- # [[ request: 00:10:40.502 { 00:10:40.502 "nqn": "nqn.2016-06.io.spdk:cnode5619", 00:10:40.502 "max_cntlid": 0, 00:10:40.502 "method": "nvmf_create_subsystem", 00:10:40.502 "req_id": 1 00:10:40.502 } 00:10:40.502 Got JSON-RPC error response 00:10:40.502 response: 00:10:40.502 { 00:10:40.502 "code": -32602, 00:10:40.502 "message": "Invalid cntlid range [1-0]" 00:10:40.502 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:10:40.502 14:58:21 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14975 -I 65520 00:10:40.763 [2024-04-26 14:58:21.455244] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14975: invalid cntlid range [1-65520] 00:10:40.763 14:58:21 -- target/invalid.sh@79 -- # out='request: 00:10:40.763 { 00:10:40.763 "nqn": "nqn.2016-06.io.spdk:cnode14975", 00:10:40.763 "max_cntlid": 65520, 00:10:40.763 "method": "nvmf_create_subsystem", 00:10:40.763 "req_id": 1 00:10:40.763 } 00:10:40.763 Got JSON-RPC error response 00:10:40.763 response: 00:10:40.763 { 00:10:40.763 "code": -32602, 00:10:40.763 "message": "Invalid cntlid range [1-65520]" 00:10:40.763 }' 00:10:40.763 14:58:21 -- target/invalid.sh@80 -- # [[ request: 00:10:40.763 { 00:10:40.763 "nqn": "nqn.2016-06.io.spdk:cnode14975", 00:10:40.763 "max_cntlid": 65520, 00:10:40.763 "method": "nvmf_create_subsystem", 00:10:40.763 "req_id": 1 00:10:40.763 } 00:10:40.763 Got JSON-RPC error response 00:10:40.763 response: 00:10:40.763 { 00:10:40.763 "code": -32602, 00:10:40.764 "message": "Invalid cntlid range [1-65520]" 00:10:40.764 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:10:40.764 14:58:21 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25612 -i 6 -I 5 00:10:40.764 [2024-04-26 14:58:21.627861] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25612: invalid cntlid range [6-5] 00:10:40.764 14:58:21 -- target/invalid.sh@83 -- # out='request: 00:10:40.764 { 00:10:40.764 "nqn": "nqn.2016-06.io.spdk:cnode25612", 00:10:40.764 "min_cntlid": 6, 00:10:40.764 "max_cntlid": 5, 00:10:40.764 "method": "nvmf_create_subsystem", 00:10:40.764 "req_id": 1 00:10:40.764 } 00:10:40.764 Got JSON-RPC error response 00:10:40.764 response: 00:10:40.764 { 00:10:40.764 "code": -32602, 00:10:40.764 "message": "Invalid cntlid range [6-5]" 00:10:40.764 }' 00:10:40.764 14:58:21 -- target/invalid.sh@84 -- # [[ request: 00:10:40.764 { 00:10:40.764 "nqn": "nqn.2016-06.io.spdk:cnode25612", 00:10:40.764 "min_cntlid": 6, 00:10:40.764 "max_cntlid": 5, 00:10:40.764 "method": "nvmf_create_subsystem", 00:10:40.764 "req_id": 1 00:10:40.764 } 00:10:40.764 Got JSON-RPC error response 00:10:40.764 response: 00:10:40.764 { 00:10:40.764 "code": -32602, 00:10:40.764 "message": "Invalid cntlid range [6-5]" 00:10:40.764 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:10:40.764 14:58:21 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:10:41.024 14:58:21 -- target/invalid.sh@87 -- # out='request: 00:10:41.024 { 00:10:41.024 "name": "foobar", 00:10:41.024 "method": "nvmf_delete_target", 00:10:41.024 "req_id": 1 00:10:41.024 } 00:10:41.024 Got JSON-RPC error response 00:10:41.024 response: 00:10:41.024 { 00:10:41.024 "code": -32602, 00:10:41.024 "message": "The specified target doesn'\''t exist, cannot delete it." 00:10:41.024 }' 00:10:41.024 14:58:21 -- target/invalid.sh@88 -- # [[ request: 00:10:41.024 { 00:10:41.024 "name": "foobar", 00:10:41.024 "method": "nvmf_delete_target", 00:10:41.024 "req_id": 1 00:10:41.024 } 00:10:41.024 Got JSON-RPC error response 00:10:41.025 response: 00:10:41.025 { 00:10:41.025 "code": -32602, 00:10:41.025 "message": "The specified target doesn't exist, cannot delete it." 00:10:41.025 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:10:41.025 14:58:21 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:10:41.025 14:58:21 -- target/invalid.sh@91 -- # nvmftestfini 00:10:41.025 14:58:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:41.025 14:58:21 -- nvmf/common.sh@117 -- # sync 00:10:41.025 14:58:21 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:41.025 14:58:21 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:41.025 14:58:21 -- nvmf/common.sh@120 -- # set +e 00:10:41.025 14:58:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:41.025 14:58:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:41.025 rmmod nvme_rdma 00:10:41.025 rmmod nvme_fabrics 00:10:41.025 14:58:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:41.025 14:58:21 -- nvmf/common.sh@124 -- # set -e 00:10:41.025 14:58:21 -- nvmf/common.sh@125 -- # return 0 00:10:41.025 14:58:21 -- nvmf/common.sh@478 -- # '[' -n 3403130 ']' 00:10:41.025 14:58:21 -- nvmf/common.sh@479 -- # killprocess 3403130 00:10:41.025 14:58:21 -- common/autotest_common.sh@946 -- # '[' -z 3403130 ']' 00:10:41.025 14:58:21 -- common/autotest_common.sh@950 -- # kill -0 3403130 00:10:41.025 14:58:21 -- common/autotest_common.sh@951 -- # uname 00:10:41.025 14:58:21 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:10:41.025 14:58:21 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3403130 00:10:41.025 14:58:21 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:10:41.025 14:58:21 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:10:41.025 14:58:21 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3403130' 00:10:41.025 killing process with pid 3403130 00:10:41.025 14:58:21 -- common/autotest_common.sh@965 -- # kill 3403130 00:10:41.025 14:58:21 -- common/autotest_common.sh@970 -- # wait 3403130 00:10:41.025 [2024-04-26 14:58:21.945394] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:41.285 14:58:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:41.285 14:58:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:41.285 00:10:41.285 real 0m11.091s 00:10:41.285 user 0m19.798s 00:10:41.285 sys 0m6.053s 00:10:41.285 14:58:22 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:10:41.285 14:58:22 -- common/autotest_common.sh@10 -- # set +x 00:10:41.285 ************************************ 00:10:41.285 END TEST nvmf_invalid 00:10:41.285 ************************************ 00:10:41.285 14:58:22 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:10:41.285 14:58:22 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:10:41.285 14:58:22 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:10:41.285 14:58:22 -- common/autotest_common.sh@10 -- # set +x 00:10:41.547 ************************************ 00:10:41.547 START TEST nvmf_abort 00:10:41.547 ************************************ 00:10:41.547 14:58:22 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:10:41.547 * Looking for test storage... 00:10:41.547 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:41.547 14:58:22 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:41.547 14:58:22 -- nvmf/common.sh@7 -- # uname -s 00:10:41.547 14:58:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:41.547 14:58:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:41.547 14:58:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:41.547 14:58:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:41.547 14:58:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:41.547 14:58:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:41.547 14:58:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:41.547 14:58:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:41.547 14:58:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:41.547 14:58:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:41.547 14:58:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:41.547 14:58:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:41.547 14:58:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:41.547 14:58:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:41.547 14:58:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:41.547 14:58:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:41.547 14:58:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:41.547 14:58:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:41.547 14:58:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:41.547 14:58:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:41.547 14:58:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:41.547 14:58:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:41.547 14:58:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:41.547 14:58:22 -- paths/export.sh@5 -- # export PATH 00:10:41.547 14:58:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:41.547 14:58:22 -- nvmf/common.sh@47 -- # : 0 00:10:41.547 14:58:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:41.547 14:58:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:41.547 14:58:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:41.547 14:58:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:41.547 14:58:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:41.547 14:58:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:41.547 14:58:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:41.547 14:58:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:41.547 14:58:22 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:41.547 14:58:22 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:10:41.547 14:58:22 -- target/abort.sh@14 -- # nvmftestinit 00:10:41.547 14:58:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:41.547 14:58:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:41.547 14:58:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:41.547 14:58:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:41.547 14:58:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:41.547 14:58:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:41.547 14:58:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:41.547 14:58:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:41.547 14:58:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:41.547 14:58:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:41.547 14:58:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:41.547 14:58:22 -- common/autotest_common.sh@10 -- # set +x 00:10:48.145 14:58:29 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:48.145 14:58:29 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:48.145 14:58:29 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:48.145 14:58:29 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:48.145 14:58:29 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:48.145 14:58:29 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:48.145 14:58:29 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:48.145 14:58:29 -- nvmf/common.sh@295 -- # net_devs=() 00:10:48.145 14:58:29 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:48.145 14:58:29 -- nvmf/common.sh@296 -- # e810=() 00:10:48.145 14:58:29 -- nvmf/common.sh@296 -- # local -ga e810 00:10:48.145 14:58:29 -- nvmf/common.sh@297 -- # x722=() 00:10:48.145 14:58:29 -- nvmf/common.sh@297 -- # local -ga x722 00:10:48.145 14:58:29 -- nvmf/common.sh@298 -- # mlx=() 00:10:48.145 14:58:29 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:48.145 14:58:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:48.145 14:58:29 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:48.145 14:58:29 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:48.145 14:58:29 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:48.145 14:58:29 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:48.145 14:58:29 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:48.145 14:58:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:48.145 14:58:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:10:48.145 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:10:48.145 14:58:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:48.145 14:58:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:48.145 14:58:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:10:48.145 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:10:48.145 14:58:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:48.145 14:58:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:48.146 14:58:29 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:48.146 14:58:29 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:48.146 14:58:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:48.146 14:58:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:48.146 14:58:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:48.146 14:58:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:48.146 14:58:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:10:48.146 Found net devices under 0000:31:00.0: mlx_0_0 00:10:48.146 14:58:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:48.146 14:58:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:48.146 14:58:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:48.146 14:58:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:48.146 14:58:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:48.146 14:58:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:10:48.146 Found net devices under 0000:31:00.1: mlx_0_1 00:10:48.146 14:58:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:48.146 14:58:29 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:48.146 14:58:29 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:48.146 14:58:29 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:48.146 14:58:29 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:48.146 14:58:29 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:48.146 14:58:29 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:48.146 14:58:29 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:48.146 14:58:29 -- nvmf/common.sh@58 -- # uname 00:10:48.146 14:58:29 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:48.146 14:58:29 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:48.146 14:58:29 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:48.146 14:58:29 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:48.146 14:58:29 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:48.146 14:58:29 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:48.406 14:58:29 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:48.406 14:58:29 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:48.406 14:58:29 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:48.406 14:58:29 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:48.406 14:58:29 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:48.406 14:58:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:48.406 14:58:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:48.406 14:58:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:48.406 14:58:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:48.406 14:58:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:48.406 14:58:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:48.406 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.406 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:48.406 14:58:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:48.406 14:58:29 -- nvmf/common.sh@105 -- # continue 2 00:10:48.406 14:58:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:48.406 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.406 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:48.406 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.406 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:48.406 14:58:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:48.406 14:58:29 -- nvmf/common.sh@105 -- # continue 2 00:10:48.406 14:58:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:48.406 14:58:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:48.406 14:58:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:48.406 14:58:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:48.407 14:58:29 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:48.407 14:58:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:48.407 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:48.407 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:10:48.407 altname enp49s0f0np0 00:10:48.407 altname ens786f0np0 00:10:48.407 inet 192.168.100.8/24 scope global mlx_0_0 00:10:48.407 valid_lft forever preferred_lft forever 00:10:48.407 14:58:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:48.407 14:58:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:48.407 14:58:29 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:48.407 14:58:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:48.407 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:48.407 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:10:48.407 altname enp49s0f1np1 00:10:48.407 altname ens786f1np1 00:10:48.407 inet 192.168.100.9/24 scope global mlx_0_1 00:10:48.407 valid_lft forever preferred_lft forever 00:10:48.407 14:58:29 -- nvmf/common.sh@411 -- # return 0 00:10:48.407 14:58:29 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:48.407 14:58:29 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:48.407 14:58:29 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:48.407 14:58:29 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:48.407 14:58:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:48.407 14:58:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:48.407 14:58:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:48.407 14:58:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:48.407 14:58:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:48.407 14:58:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:48.407 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.407 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:48.407 14:58:29 -- nvmf/common.sh@105 -- # continue 2 00:10:48.407 14:58:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:48.407 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.407 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:48.407 14:58:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:48.407 14:58:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@105 -- # continue 2 00:10:48.407 14:58:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:48.407 14:58:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:48.407 14:58:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:48.407 14:58:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:48.407 14:58:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:48.407 14:58:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:48.407 14:58:29 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:48.407 192.168.100.9' 00:10:48.407 14:58:29 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:48.407 192.168.100.9' 00:10:48.407 14:58:29 -- nvmf/common.sh@446 -- # head -n 1 00:10:48.407 14:58:29 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:48.407 14:58:29 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:48.407 192.168.100.9' 00:10:48.407 14:58:29 -- nvmf/common.sh@447 -- # tail -n +2 00:10:48.407 14:58:29 -- nvmf/common.sh@447 -- # head -n 1 00:10:48.407 14:58:29 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:48.407 14:58:29 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:48.407 14:58:29 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:48.407 14:58:29 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:48.407 14:58:29 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:48.407 14:58:29 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:48.407 14:58:29 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:10:48.407 14:58:29 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:48.407 14:58:29 -- common/autotest_common.sh@720 -- # xtrace_disable 00:10:48.407 14:58:29 -- common/autotest_common.sh@10 -- # set +x 00:10:48.407 14:58:29 -- nvmf/common.sh@470 -- # nvmfpid=3407776 00:10:48.407 14:58:29 -- nvmf/common.sh@471 -- # waitforlisten 3407776 00:10:48.407 14:58:29 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:48.407 14:58:29 -- common/autotest_common.sh@827 -- # '[' -z 3407776 ']' 00:10:48.407 14:58:29 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:48.407 14:58:29 -- common/autotest_common.sh@832 -- # local max_retries=100 00:10:48.407 14:58:29 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:48.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:48.407 14:58:29 -- common/autotest_common.sh@836 -- # xtrace_disable 00:10:48.407 14:58:29 -- common/autotest_common.sh@10 -- # set +x 00:10:48.407 [2024-04-26 14:58:29.332298] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:10:48.407 [2024-04-26 14:58:29.332347] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:48.668 EAL: No free 2048 kB hugepages reported on node 1 00:10:48.668 [2024-04-26 14:58:29.391807] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:48.668 [2024-04-26 14:58:29.453951] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:48.668 [2024-04-26 14:58:29.453989] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:48.668 [2024-04-26 14:58:29.453997] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:48.668 [2024-04-26 14:58:29.454003] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:48.668 [2024-04-26 14:58:29.454009] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:48.668 [2024-04-26 14:58:29.454120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:48.668 [2024-04-26 14:58:29.454260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:48.668 [2024-04-26 14:58:29.454262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:49.239 14:58:30 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:10:49.239 14:58:30 -- common/autotest_common.sh@860 -- # return 0 00:10:49.239 14:58:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:49.239 14:58:30 -- common/autotest_common.sh@726 -- # xtrace_disable 00:10:49.239 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.239 14:58:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:49.239 14:58:30 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:10:49.239 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.239 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.239 [2024-04-26 14:58:30.183491] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x7e72f0/0x7eb7e0) succeed. 00:10:49.500 [2024-04-26 14:58:30.197826] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x7e8890/0x82ce70) succeed. 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 Malloc0 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 Delay0 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 [2024-04-26 14:58:30.345926] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:10:49.500 14:58:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.500 14:58:30 -- common/autotest_common.sh@10 -- # set +x 00:10:49.500 14:58:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.500 14:58:30 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:10:49.500 EAL: No free 2048 kB hugepages reported on node 1 00:10:49.761 [2024-04-26 14:58:30.452002] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:10:51.672 Initializing NVMe Controllers 00:10:51.672 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:10:51.672 controller IO queue size 128 less than required 00:10:51.672 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:10:51.672 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:10:51.672 Initialization complete. Launching workers. 00:10:51.672 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 38116 00:10:51.672 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 38177, failed to submit 62 00:10:51.672 success 38117, unsuccess 60, failed 0 00:10:51.672 14:58:32 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:10:51.672 14:58:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:51.672 14:58:32 -- common/autotest_common.sh@10 -- # set +x 00:10:51.672 14:58:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:51.672 14:58:32 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:10:51.672 14:58:32 -- target/abort.sh@38 -- # nvmftestfini 00:10:51.672 14:58:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:51.672 14:58:32 -- nvmf/common.sh@117 -- # sync 00:10:51.672 14:58:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:51.672 14:58:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:51.672 14:58:32 -- nvmf/common.sh@120 -- # set +e 00:10:51.672 14:58:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:51.672 14:58:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:51.672 rmmod nvme_rdma 00:10:51.672 rmmod nvme_fabrics 00:10:51.932 14:58:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:51.932 14:58:32 -- nvmf/common.sh@124 -- # set -e 00:10:51.932 14:58:32 -- nvmf/common.sh@125 -- # return 0 00:10:51.932 14:58:32 -- nvmf/common.sh@478 -- # '[' -n 3407776 ']' 00:10:51.932 14:58:32 -- nvmf/common.sh@479 -- # killprocess 3407776 00:10:51.932 14:58:32 -- common/autotest_common.sh@946 -- # '[' -z 3407776 ']' 00:10:51.932 14:58:32 -- common/autotest_common.sh@950 -- # kill -0 3407776 00:10:51.932 14:58:32 -- common/autotest_common.sh@951 -- # uname 00:10:51.932 14:58:32 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:10:51.932 14:58:32 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3407776 00:10:51.932 14:58:32 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:10:51.932 14:58:32 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:10:51.932 14:58:32 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3407776' 00:10:51.932 killing process with pid 3407776 00:10:51.932 14:58:32 -- common/autotest_common.sh@965 -- # kill 3407776 00:10:51.932 14:58:32 -- common/autotest_common.sh@970 -- # wait 3407776 00:10:51.932 [2024-04-26 14:58:32.758007] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:52.192 14:58:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:52.192 14:58:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:52.192 00:10:52.192 real 0m10.631s 00:10:52.192 user 0m14.470s 00:10:52.192 sys 0m5.477s 00:10:52.192 14:58:32 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:10:52.192 14:58:32 -- common/autotest_common.sh@10 -- # set +x 00:10:52.192 ************************************ 00:10:52.192 END TEST nvmf_abort 00:10:52.192 ************************************ 00:10:52.192 14:58:32 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:10:52.192 14:58:32 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:10:52.192 14:58:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:10:52.192 14:58:32 -- common/autotest_common.sh@10 -- # set +x 00:10:52.192 ************************************ 00:10:52.192 START TEST nvmf_ns_hotplug_stress 00:10:52.192 ************************************ 00:10:52.192 14:58:33 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:10:52.453 * Looking for test storage... 00:10:52.453 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:52.453 14:58:33 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:52.453 14:58:33 -- nvmf/common.sh@7 -- # uname -s 00:10:52.453 14:58:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:52.453 14:58:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:52.453 14:58:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:52.453 14:58:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:52.453 14:58:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:52.453 14:58:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:52.453 14:58:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:52.453 14:58:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:52.453 14:58:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:52.453 14:58:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:52.453 14:58:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:52.453 14:58:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:10:52.453 14:58:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:52.453 14:58:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:52.453 14:58:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:52.453 14:58:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:52.453 14:58:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:52.453 14:58:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:52.453 14:58:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:52.453 14:58:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:52.453 14:58:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.453 14:58:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.453 14:58:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.453 14:58:33 -- paths/export.sh@5 -- # export PATH 00:10:52.453 14:58:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.453 14:58:33 -- nvmf/common.sh@47 -- # : 0 00:10:52.453 14:58:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:52.453 14:58:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:52.453 14:58:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:52.453 14:58:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:52.453 14:58:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:52.453 14:58:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:52.453 14:58:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:52.453 14:58:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:52.453 14:58:33 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:52.453 14:58:33 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:10:52.453 14:58:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:52.453 14:58:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:52.454 14:58:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:52.454 14:58:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:52.454 14:58:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:52.454 14:58:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:52.454 14:58:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:52.454 14:58:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:52.454 14:58:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:52.454 14:58:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:52.454 14:58:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:52.454 14:58:33 -- common/autotest_common.sh@10 -- # set +x 00:10:59.041 14:58:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:59.041 14:58:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:59.041 14:58:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:59.041 14:58:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:59.041 14:58:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:59.041 14:58:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:59.041 14:58:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:59.041 14:58:39 -- nvmf/common.sh@295 -- # net_devs=() 00:10:59.041 14:58:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:59.041 14:58:39 -- nvmf/common.sh@296 -- # e810=() 00:10:59.041 14:58:39 -- nvmf/common.sh@296 -- # local -ga e810 00:10:59.041 14:58:39 -- nvmf/common.sh@297 -- # x722=() 00:10:59.041 14:58:39 -- nvmf/common.sh@297 -- # local -ga x722 00:10:59.041 14:58:39 -- nvmf/common.sh@298 -- # mlx=() 00:10:59.041 14:58:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:59.041 14:58:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:59.041 14:58:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:10:59.041 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:10:59.041 14:58:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.041 14:58:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:10:59.041 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:10:59.041 14:58:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.041 14:58:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.041 14:58:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.041 14:58:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:10:59.041 Found net devices under 0000:31:00.0: mlx_0_0 00:10:59.041 14:58:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.041 14:58:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.041 14:58:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:10:59.041 Found net devices under 0000:31:00.1: mlx_0_1 00:10:59.041 14:58:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.041 14:58:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:59.041 14:58:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:59.041 14:58:39 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:59.041 14:58:39 -- nvmf/common.sh@58 -- # uname 00:10:59.041 14:58:39 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:59.041 14:58:39 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:59.041 14:58:39 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:59.041 14:58:39 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:59.041 14:58:39 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:59.041 14:58:39 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:59.041 14:58:39 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:59.041 14:58:39 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:59.041 14:58:39 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:59.041 14:58:39 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:59.041 14:58:39 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:59.041 14:58:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.041 14:58:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.041 14:58:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.041 14:58:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.041 14:58:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.041 14:58:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.041 14:58:39 -- nvmf/common.sh@105 -- # continue 2 00:10:59.041 14:58:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.041 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.041 14:58:39 -- nvmf/common.sh@105 -- # continue 2 00:10:59.041 14:58:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.041 14:58:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:59.041 14:58:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.041 14:58:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:59.041 14:58:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:59.041 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.041 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:10:59.041 altname enp49s0f0np0 00:10:59.041 altname ens786f0np0 00:10:59.041 inet 192.168.100.8/24 scope global mlx_0_0 00:10:59.041 valid_lft forever preferred_lft forever 00:10:59.041 14:58:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.041 14:58:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:59.041 14:58:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.041 14:58:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.041 14:58:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:59.041 14:58:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:59.041 14:58:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:59.041 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.041 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:10:59.041 altname enp49s0f1np1 00:10:59.041 altname ens786f1np1 00:10:59.041 inet 192.168.100.9/24 scope global mlx_0_1 00:10:59.041 valid_lft forever preferred_lft forever 00:10:59.042 14:58:39 -- nvmf/common.sh@411 -- # return 0 00:10:59.042 14:58:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:59.042 14:58:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:59.042 14:58:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:59.042 14:58:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:59.042 14:58:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:59.042 14:58:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.042 14:58:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.042 14:58:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.042 14:58:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.042 14:58:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.042 14:58:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.042 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.042 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.042 14:58:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.042 14:58:39 -- nvmf/common.sh@105 -- # continue 2 00:10:59.042 14:58:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.042 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.042 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.042 14:58:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.042 14:58:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.042 14:58:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.042 14:58:39 -- nvmf/common.sh@105 -- # continue 2 00:10:59.042 14:58:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.042 14:58:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:59.042 14:58:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.042 14:58:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.042 14:58:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:59.042 14:58:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.042 14:58:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.042 14:58:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:59.042 192.168.100.9' 00:10:59.042 14:58:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:59.042 192.168.100.9' 00:10:59.042 14:58:39 -- nvmf/common.sh@446 -- # head -n 1 00:10:59.042 14:58:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:59.042 14:58:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:59.042 192.168.100.9' 00:10:59.042 14:58:39 -- nvmf/common.sh@447 -- # tail -n +2 00:10:59.042 14:58:39 -- nvmf/common.sh@447 -- # head -n 1 00:10:59.042 14:58:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:59.042 14:58:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:59.042 14:58:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:59.042 14:58:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:59.042 14:58:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:59.042 14:58:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:59.042 14:58:39 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:10:59.042 14:58:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:59.042 14:58:39 -- common/autotest_common.sh@720 -- # xtrace_disable 00:10:59.042 14:58:39 -- common/autotest_common.sh@10 -- # set +x 00:10:59.042 14:58:39 -- nvmf/common.sh@470 -- # nvmfpid=3412125 00:10:59.042 14:58:39 -- nvmf/common.sh@471 -- # waitforlisten 3412125 00:10:59.042 14:58:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:59.042 14:58:39 -- common/autotest_common.sh@827 -- # '[' -z 3412125 ']' 00:10:59.042 14:58:39 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:59.042 14:58:39 -- common/autotest_common.sh@832 -- # local max_retries=100 00:10:59.042 14:58:39 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:59.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:59.042 14:58:39 -- common/autotest_common.sh@836 -- # xtrace_disable 00:10:59.042 14:58:39 -- common/autotest_common.sh@10 -- # set +x 00:10:59.302 [2024-04-26 14:58:40.020483] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:10:59.302 [2024-04-26 14:58:40.020540] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:59.302 EAL: No free 2048 kB hugepages reported on node 1 00:10:59.302 [2024-04-26 14:58:40.083054] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:59.302 [2024-04-26 14:58:40.150711] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:59.302 [2024-04-26 14:58:40.150747] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:59.302 [2024-04-26 14:58:40.150754] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:59.302 [2024-04-26 14:58:40.150761] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:59.302 [2024-04-26 14:58:40.150767] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:59.302 [2024-04-26 14:58:40.150891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:59.302 [2024-04-26 14:58:40.151031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:59.302 [2024-04-26 14:58:40.151034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:59.873 14:58:40 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:10:59.873 14:58:40 -- common/autotest_common.sh@860 -- # return 0 00:10:59.873 14:58:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:59.873 14:58:40 -- common/autotest_common.sh@726 -- # xtrace_disable 00:10:59.873 14:58:40 -- common/autotest_common.sh@10 -- # set +x 00:11:00.133 14:58:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:00.133 14:58:40 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:11:00.133 14:58:40 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:00.133 [2024-04-26 14:58:40.996327] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21fa2f0/0x21fe7e0) succeed. 00:11:00.133 [2024-04-26 14:58:41.010257] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21fb890/0x223fe70) succeed. 00:11:00.393 14:58:41 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:00.393 14:58:41 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:00.652 [2024-04-26 14:58:41.439421] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:00.652 14:58:41 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:00.913 14:58:41 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:11:00.913 Malloc0 00:11:00.913 14:58:41 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:01.188 Delay0 00:11:01.188 14:58:41 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:01.491 14:58:42 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:11:01.491 NULL1 00:11:01.491 14:58:42 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:01.757 14:58:42 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=3412805 00:11:01.757 14:58:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:01.757 14:58:42 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:11:01.757 14:58:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:01.757 EAL: No free 2048 kB hugepages reported on node 1 00:11:01.757 Read completed with error (sct=0, sc=11) 00:11:01.757 14:58:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:01.757 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:01.757 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:01.757 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:01.757 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.017 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.017 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.017 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.017 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.017 14:58:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:11:02.017 14:58:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:11:02.017 [2024-04-26 14:58:42.919859] bdev.c:4971:_tmp_bdev_event_cb: *NOTICE*: Unexpected event type: 1 00:11:02.017 true 00:11:02.017 14:58:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:02.017 14:58:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 14:58:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:02.959 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:03.219 14:58:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:11:03.219 14:58:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:11:03.219 true 00:11:03.219 14:58:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:03.219 14:58:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 14:58:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.159 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.418 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:04.418 14:58:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:11:04.418 14:58:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:11:04.418 true 00:11:04.418 14:58:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:04.418 14:58:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 14:58:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.357 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:05.617 14:58:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:11:05.617 14:58:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:11:05.617 true 00:11:05.617 14:58:46 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:05.617 14:58:46 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 14:58:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:06.556 14:58:47 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:11:06.556 14:58:47 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:11:06.816 true 00:11:06.816 14:58:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:06.816 14:58:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 14:58:48 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:07.755 14:58:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:11:07.755 14:58:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:11:08.015 true 00:11:08.015 14:58:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:08.015 14:58:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 14:58:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:08.956 14:58:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:11:08.956 14:58:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:11:09.216 true 00:11:09.216 14:58:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:09.216 14:58:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.155 14:58:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.155 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.156 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:10.415 14:58:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:11:10.415 14:58:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:11:10.415 true 00:11:10.415 14:58:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:10.415 14:58:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 14:58:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.353 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:11.613 14:58:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:11:11.613 14:58:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:11:11.613 true 00:11:11.613 14:58:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:11.613 14:58:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 14:58:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:12.551 14:58:53 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:11:12.551 14:58:53 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:11:12.811 true 00:11:12.811 14:58:53 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:12.811 14:58:53 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 14:58:54 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:13.754 14:58:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:11:13.754 14:58:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:11:14.014 true 00:11:14.014 14:58:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:14.014 14:58:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 14:58:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:14.955 14:58:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:11:14.955 14:58:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:11:15.217 true 00:11:15.217 14:58:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:15.217 14:58:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:16.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:16.158 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:16.158 14:58:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:16.158 14:58:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:11:16.158 14:58:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:11:16.419 true 00:11:16.419 14:58:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:16.419 14:58:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 14:58:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:17.363 14:58:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:11:17.363 14:58:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:11:17.624 true 00:11:17.624 14:58:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:17.624 14:58:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 14:58:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:18.566 14:58:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:11:18.566 14:58:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:11:18.826 true 00:11:18.826 14:58:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:18.826 14:58:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 14:59:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:19.766 14:59:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:11:19.766 14:59:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:11:19.766 true 00:11:20.025 14:59:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:20.025 14:59:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:20.596 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 14:59:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:20.856 14:59:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:11:20.856 14:59:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:11:21.116 true 00:11:21.116 14:59:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:21.116 14:59:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 14:59:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:22.057 14:59:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:11:22.057 14:59:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:11:22.318 true 00:11:22.318 14:59:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:22.318 14:59:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:23.260 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:23.260 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:23.260 14:59:03 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:23.260 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:23.260 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:23.260 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:23.260 14:59:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:11:23.260 14:59:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:11:23.260 true 00:11:23.521 14:59:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:23.521 14:59:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 14:59:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:24.463 14:59:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:11:24.463 14:59:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:11:24.723 true 00:11:24.723 14:59:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:24.723 14:59:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 14:59:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:25.665 14:59:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:11:25.665 14:59:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:11:25.926 true 00:11:25.926 14:59:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:25.926 14:59:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 14:59:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:26.869 14:59:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:11:26.869 14:59:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:11:27.131 true 00:11:27.131 14:59:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:27.131 14:59:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 14:59:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:28.074 14:59:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:11:28.074 14:59:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:11:28.074 true 00:11:28.335 14:59:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:28.335 14:59:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 14:59:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:29.279 14:59:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:11:29.279 14:59:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:11:29.279 true 00:11:29.279 14:59:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:29.279 14:59:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:30.223 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:30.223 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:30.223 14:59:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:30.487 14:59:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:11:30.487 14:59:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:11:30.487 true 00:11:30.487 14:59:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:30.487 14:59:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 14:59:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.482 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:11:31.743 14:59:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:11:31.743 14:59:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:11:31.743 true 00:11:31.743 14:59:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:31.743 14:59:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:32.684 14:59:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:32.945 14:59:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:11:32.945 14:59:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:11:32.945 true 00:11:32.945 14:59:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:32.945 14:59:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:33.205 14:59:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:33.205 14:59:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:11:33.205 14:59:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:11:33.465 true 00:11:33.465 14:59:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:33.465 14:59:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:33.726 14:59:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:33.726 14:59:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:11:33.726 14:59:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:11:33.985 true 00:11:33.985 14:59:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:33.985 14:59:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:34.279 14:59:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:34.279 14:59:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:11:34.279 14:59:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:11:34.539 true 00:11:34.539 14:59:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:34.539 14:59:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:34.539 14:59:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:34.799 Initializing NVMe Controllers 00:11:34.799 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:34.799 Controller IO queue size 128, less than required. 00:11:34.799 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:34.799 Controller IO queue size 128, less than required. 00:11:34.799 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:34.799 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:11:34.799 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:11:34.799 Initialization complete. Launching workers. 00:11:34.799 ======================================================== 00:11:34.799 Latency(us) 00:11:34.799 Device Information : IOPS MiB/s Average min max 00:11:34.799 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7814.30 3.82 14700.14 1246.24 1186996.60 00:11:34.799 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 28702.30 14.01 4459.38 1895.35 393774.66 00:11:34.799 ======================================================== 00:11:34.799 Total : 36516.60 17.83 6650.83 1246.24 1186996.60 00:11:34.799 00:11:34.799 14:59:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1031 00:11:34.799 14:59:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:11:35.058 true 00:11:35.059 14:59:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3412805 00:11:35.059 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (3412805) - No such process 00:11:35.059 14:59:15 -- target/ns_hotplug_stress.sh@44 -- # wait 3412805 00:11:35.059 14:59:15 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:11:35.059 14:59:15 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:11:35.059 14:59:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:35.059 14:59:15 -- nvmf/common.sh@117 -- # sync 00:11:35.059 14:59:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:35.059 14:59:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:35.059 14:59:15 -- nvmf/common.sh@120 -- # set +e 00:11:35.059 14:59:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:35.059 14:59:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:35.059 rmmod nvme_rdma 00:11:35.059 rmmod nvme_fabrics 00:11:35.059 14:59:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:35.059 14:59:15 -- nvmf/common.sh@124 -- # set -e 00:11:35.059 14:59:15 -- nvmf/common.sh@125 -- # return 0 00:11:35.059 14:59:15 -- nvmf/common.sh@478 -- # '[' -n 3412125 ']' 00:11:35.059 14:59:15 -- nvmf/common.sh@479 -- # killprocess 3412125 00:11:35.059 14:59:15 -- common/autotest_common.sh@946 -- # '[' -z 3412125 ']' 00:11:35.059 14:59:15 -- common/autotest_common.sh@950 -- # kill -0 3412125 00:11:35.059 14:59:15 -- common/autotest_common.sh@951 -- # uname 00:11:35.059 14:59:15 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:35.059 14:59:15 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3412125 00:11:35.059 14:59:15 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:11:35.059 14:59:15 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:11:35.059 14:59:15 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3412125' 00:11:35.059 killing process with pid 3412125 00:11:35.059 14:59:15 -- common/autotest_common.sh@965 -- # kill 3412125 00:11:35.059 14:59:15 -- common/autotest_common.sh@970 -- # wait 3412125 00:11:35.059 [2024-04-26 14:59:15.996926] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:35.319 14:59:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:35.319 14:59:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:35.319 00:11:35.319 real 0m43.036s 00:11:35.319 user 2m36.465s 00:11:35.319 sys 0m7.888s 00:11:35.319 14:59:16 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:35.319 14:59:16 -- common/autotest_common.sh@10 -- # set +x 00:11:35.319 ************************************ 00:11:35.319 END TEST nvmf_ns_hotplug_stress 00:11:35.319 ************************************ 00:11:35.319 14:59:16 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:11:35.319 14:59:16 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:35.319 14:59:16 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:35.319 14:59:16 -- common/autotest_common.sh@10 -- # set +x 00:11:35.580 ************************************ 00:11:35.580 START TEST nvmf_connect_stress 00:11:35.580 ************************************ 00:11:35.580 14:59:16 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:11:35.580 * Looking for test storage... 00:11:35.580 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:35.580 14:59:16 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:35.580 14:59:16 -- nvmf/common.sh@7 -- # uname -s 00:11:35.580 14:59:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:35.580 14:59:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:35.580 14:59:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:35.580 14:59:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:35.580 14:59:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:35.580 14:59:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:35.580 14:59:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:35.580 14:59:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:35.580 14:59:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:35.580 14:59:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:35.580 14:59:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:35.580 14:59:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:35.580 14:59:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:35.580 14:59:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:35.580 14:59:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:35.580 14:59:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:35.580 14:59:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:35.580 14:59:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:35.580 14:59:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:35.580 14:59:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:35.580 14:59:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.580 14:59:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.580 14:59:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.580 14:59:16 -- paths/export.sh@5 -- # export PATH 00:11:35.580 14:59:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:35.580 14:59:16 -- nvmf/common.sh@47 -- # : 0 00:11:35.580 14:59:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:35.580 14:59:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:35.580 14:59:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:35.580 14:59:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:35.580 14:59:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:35.580 14:59:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:35.580 14:59:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:35.580 14:59:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:35.580 14:59:16 -- target/connect_stress.sh@12 -- # nvmftestinit 00:11:35.580 14:59:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:35.580 14:59:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:35.580 14:59:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:35.581 14:59:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:35.581 14:59:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:35.581 14:59:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:35.581 14:59:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:35.581 14:59:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:35.581 14:59:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:35.581 14:59:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:35.581 14:59:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:35.581 14:59:16 -- common/autotest_common.sh@10 -- # set +x 00:11:42.170 14:59:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:42.170 14:59:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:42.170 14:59:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:42.170 14:59:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:42.170 14:59:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:42.170 14:59:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:42.170 14:59:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:42.170 14:59:23 -- nvmf/common.sh@295 -- # net_devs=() 00:11:42.170 14:59:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:42.170 14:59:23 -- nvmf/common.sh@296 -- # e810=() 00:11:42.170 14:59:23 -- nvmf/common.sh@296 -- # local -ga e810 00:11:42.170 14:59:23 -- nvmf/common.sh@297 -- # x722=() 00:11:42.170 14:59:23 -- nvmf/common.sh@297 -- # local -ga x722 00:11:42.170 14:59:23 -- nvmf/common.sh@298 -- # mlx=() 00:11:42.170 14:59:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:42.170 14:59:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:42.170 14:59:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:42.170 14:59:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:42.170 14:59:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:11:42.170 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:11:42.170 14:59:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:42.170 14:59:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:42.170 14:59:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:11:42.170 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:11:42.170 14:59:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:42.170 14:59:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:42.170 14:59:23 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:42.170 14:59:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:42.170 14:59:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:42.170 14:59:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:42.170 14:59:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:11:42.170 Found net devices under 0000:31:00.0: mlx_0_0 00:11:42.170 14:59:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:42.170 14:59:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:42.170 14:59:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:42.170 14:59:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:42.170 14:59:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:11:42.170 Found net devices under 0000:31:00.1: mlx_0_1 00:11:42.170 14:59:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:42.170 14:59:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:42.170 14:59:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:42.170 14:59:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:42.170 14:59:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:42.170 14:59:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:42.170 14:59:23 -- nvmf/common.sh@58 -- # uname 00:11:42.170 14:59:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:42.170 14:59:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:42.170 14:59:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:42.170 14:59:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:42.170 14:59:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:42.170 14:59:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:42.170 14:59:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:42.170 14:59:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:42.170 14:59:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:42.170 14:59:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:42.170 14:59:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:42.170 14:59:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:42.170 14:59:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:42.170 14:59:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:42.170 14:59:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:42.431 14:59:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:42.431 14:59:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:42.431 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.431 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:42.431 14:59:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:42.431 14:59:23 -- nvmf/common.sh@105 -- # continue 2 00:11:42.431 14:59:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:42.431 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.431 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:42.431 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.431 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:42.431 14:59:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:42.431 14:59:23 -- nvmf/common.sh@105 -- # continue 2 00:11:42.431 14:59:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:42.431 14:59:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:42.431 14:59:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:42.431 14:59:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:42.431 14:59:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:42.431 14:59:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:42.431 14:59:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:42.431 14:59:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:42.431 14:59:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:42.431 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:42.432 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:11:42.432 altname enp49s0f0np0 00:11:42.432 altname ens786f0np0 00:11:42.432 inet 192.168.100.8/24 scope global mlx_0_0 00:11:42.432 valid_lft forever preferred_lft forever 00:11:42.432 14:59:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:42.432 14:59:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:42.432 14:59:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:42.432 14:59:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:42.432 14:59:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:42.432 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:42.432 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:11:42.432 altname enp49s0f1np1 00:11:42.432 altname ens786f1np1 00:11:42.432 inet 192.168.100.9/24 scope global mlx_0_1 00:11:42.432 valid_lft forever preferred_lft forever 00:11:42.432 14:59:23 -- nvmf/common.sh@411 -- # return 0 00:11:42.432 14:59:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:42.432 14:59:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:42.432 14:59:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:42.432 14:59:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:42.432 14:59:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:42.432 14:59:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:42.432 14:59:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:42.432 14:59:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:42.432 14:59:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:42.432 14:59:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:42.432 14:59:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:42.432 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.432 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:42.432 14:59:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:42.432 14:59:23 -- nvmf/common.sh@105 -- # continue 2 00:11:42.432 14:59:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:42.432 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.432 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:42.432 14:59:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:42.432 14:59:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:42.432 14:59:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@105 -- # continue 2 00:11:42.432 14:59:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:42.432 14:59:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:42.432 14:59:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:42.432 14:59:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:42.432 14:59:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:42.432 14:59:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:42.432 14:59:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:42.432 192.168.100.9' 00:11:42.432 14:59:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:42.432 192.168.100.9' 00:11:42.432 14:59:23 -- nvmf/common.sh@446 -- # head -n 1 00:11:42.432 14:59:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:42.432 14:59:23 -- nvmf/common.sh@447 -- # head -n 1 00:11:42.432 14:59:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:42.432 192.168.100.9' 00:11:42.432 14:59:23 -- nvmf/common.sh@447 -- # tail -n +2 00:11:42.432 14:59:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:42.432 14:59:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:42.432 14:59:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:42.432 14:59:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:42.432 14:59:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:42.432 14:59:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:42.432 14:59:23 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:11:42.432 14:59:23 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:42.432 14:59:23 -- common/autotest_common.sh@720 -- # xtrace_disable 00:11:42.432 14:59:23 -- common/autotest_common.sh@10 -- # set +x 00:11:42.432 14:59:23 -- nvmf/common.sh@470 -- # nvmfpid=3423163 00:11:42.432 14:59:23 -- nvmf/common.sh@471 -- # waitforlisten 3423163 00:11:42.432 14:59:23 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:42.432 14:59:23 -- common/autotest_common.sh@827 -- # '[' -z 3423163 ']' 00:11:42.432 14:59:23 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:42.432 14:59:23 -- common/autotest_common.sh@832 -- # local max_retries=100 00:11:42.432 14:59:23 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:42.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:42.432 14:59:23 -- common/autotest_common.sh@836 -- # xtrace_disable 00:11:42.432 14:59:23 -- common/autotest_common.sh@10 -- # set +x 00:11:42.432 [2024-04-26 14:59:23.327308] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:11:42.432 [2024-04-26 14:59:23.327359] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:42.432 EAL: No free 2048 kB hugepages reported on node 1 00:11:42.693 [2024-04-26 14:59:23.386471] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:42.693 [2024-04-26 14:59:23.449289] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:42.693 [2024-04-26 14:59:23.449325] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:42.693 [2024-04-26 14:59:23.449332] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:42.693 [2024-04-26 14:59:23.449339] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:42.693 [2024-04-26 14:59:23.449344] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:42.693 [2024-04-26 14:59:23.449511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:42.693 [2024-04-26 14:59:23.449686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:42.693 [2024-04-26 14:59:23.449690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:43.264 14:59:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:11:43.264 14:59:24 -- common/autotest_common.sh@860 -- # return 0 00:11:43.264 14:59:24 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:43.264 14:59:24 -- common/autotest_common.sh@726 -- # xtrace_disable 00:11:43.264 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:43.264 14:59:24 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:43.264 14:59:24 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:43.264 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:43.264 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:43.264 [2024-04-26 14:59:24.175584] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb942f0/0xb987e0) succeed. 00:11:43.264 [2024-04-26 14:59:24.189580] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb95890/0xbd9e70) succeed. 00:11:43.524 14:59:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:43.525 14:59:24 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:43.525 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:43.525 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:43.525 14:59:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:43.525 14:59:24 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:43.525 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:43.525 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:43.525 [2024-04-26 14:59:24.310128] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:43.525 14:59:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:43.525 14:59:24 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:11:43.525 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:43.525 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:43.525 NULL1 00:11:43.525 14:59:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:43.525 14:59:24 -- target/connect_stress.sh@21 -- # PERF_PID=3423285 00:11:43.525 14:59:24 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:11:43.525 14:59:24 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:11:43.525 14:59:24 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # seq 1 20 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 EAL: No free 2048 kB hugepages reported on node 1 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:43.525 14:59:24 -- target/connect_stress.sh@28 -- # cat 00:11:43.525 14:59:24 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:43.525 14:59:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:43.525 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:43.525 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:44.098 14:59:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:44.098 14:59:24 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:44.098 14:59:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:44.098 14:59:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:44.098 14:59:24 -- common/autotest_common.sh@10 -- # set +x 00:11:44.358 14:59:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:44.358 14:59:25 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:44.358 14:59:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:44.358 14:59:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:44.358 14:59:25 -- common/autotest_common.sh@10 -- # set +x 00:11:44.619 14:59:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:44.619 14:59:25 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:44.619 14:59:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:44.619 14:59:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:44.619 14:59:25 -- common/autotest_common.sh@10 -- # set +x 00:11:44.880 14:59:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:44.880 14:59:25 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:44.880 14:59:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:44.880 14:59:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:44.880 14:59:25 -- common/autotest_common.sh@10 -- # set +x 00:11:45.142 14:59:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:45.142 14:59:26 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:45.142 14:59:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:45.142 14:59:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:45.142 14:59:26 -- common/autotest_common.sh@10 -- # set +x 00:11:45.713 14:59:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:45.713 14:59:26 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:45.713 14:59:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:45.713 14:59:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:45.713 14:59:26 -- common/autotest_common.sh@10 -- # set +x 00:11:45.974 14:59:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:45.974 14:59:26 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:45.974 14:59:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:45.974 14:59:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:45.974 14:59:26 -- common/autotest_common.sh@10 -- # set +x 00:11:46.234 14:59:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:46.234 14:59:27 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:46.234 14:59:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:46.234 14:59:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:46.234 14:59:27 -- common/autotest_common.sh@10 -- # set +x 00:11:46.495 14:59:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:46.495 14:59:27 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:46.495 14:59:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:46.495 14:59:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:46.495 14:59:27 -- common/autotest_common.sh@10 -- # set +x 00:11:47.067 14:59:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:47.067 14:59:27 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:47.067 14:59:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:47.067 14:59:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:47.067 14:59:27 -- common/autotest_common.sh@10 -- # set +x 00:11:47.327 14:59:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:47.327 14:59:28 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:47.327 14:59:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:47.327 14:59:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:47.327 14:59:28 -- common/autotest_common.sh@10 -- # set +x 00:11:47.587 14:59:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:47.588 14:59:28 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:47.588 14:59:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:47.588 14:59:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:47.588 14:59:28 -- common/autotest_common.sh@10 -- # set +x 00:11:47.848 14:59:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:47.848 14:59:28 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:47.848 14:59:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:47.848 14:59:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:47.848 14:59:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.108 14:59:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.108 14:59:29 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:48.108 14:59:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:48.108 14:59:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.108 14:59:29 -- common/autotest_common.sh@10 -- # set +x 00:11:48.679 14:59:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.679 14:59:29 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:48.679 14:59:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:48.680 14:59:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.680 14:59:29 -- common/autotest_common.sh@10 -- # set +x 00:11:48.941 14:59:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.941 14:59:29 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:48.941 14:59:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:48.941 14:59:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.941 14:59:29 -- common/autotest_common.sh@10 -- # set +x 00:11:49.202 14:59:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:49.202 14:59:30 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:49.202 14:59:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:49.202 14:59:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:49.202 14:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:49.464 14:59:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:49.464 14:59:30 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:49.464 14:59:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:49.464 14:59:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:49.464 14:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:50.035 14:59:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:50.035 14:59:30 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:50.035 14:59:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:50.035 14:59:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:50.035 14:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:50.295 14:59:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:50.295 14:59:31 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:50.295 14:59:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:50.295 14:59:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:50.295 14:59:31 -- common/autotest_common.sh@10 -- # set +x 00:11:50.556 14:59:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:50.556 14:59:31 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:50.556 14:59:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:50.556 14:59:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:50.556 14:59:31 -- common/autotest_common.sh@10 -- # set +x 00:11:50.817 14:59:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:50.817 14:59:31 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:50.817 14:59:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:50.817 14:59:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:50.817 14:59:31 -- common/autotest_common.sh@10 -- # set +x 00:11:51.389 14:59:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:51.389 14:59:32 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:51.389 14:59:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:51.389 14:59:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:51.389 14:59:32 -- common/autotest_common.sh@10 -- # set +x 00:11:51.650 14:59:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:51.650 14:59:32 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:51.650 14:59:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:51.650 14:59:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:51.650 14:59:32 -- common/autotest_common.sh@10 -- # set +x 00:11:51.910 14:59:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:51.910 14:59:32 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:51.910 14:59:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:51.910 14:59:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:51.910 14:59:32 -- common/autotest_common.sh@10 -- # set +x 00:11:52.171 14:59:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:52.171 14:59:33 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:52.171 14:59:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:52.171 14:59:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:52.171 14:59:33 -- common/autotest_common.sh@10 -- # set +x 00:11:52.432 14:59:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:52.432 14:59:33 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:52.432 14:59:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:52.432 14:59:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:52.432 14:59:33 -- common/autotest_common.sh@10 -- # set +x 00:11:53.004 14:59:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:53.004 14:59:33 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:53.004 14:59:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:53.004 14:59:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:53.004 14:59:33 -- common/autotest_common.sh@10 -- # set +x 00:11:53.264 14:59:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:53.264 14:59:34 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:53.264 14:59:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:53.264 14:59:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:53.264 14:59:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.524 14:59:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:53.524 14:59:34 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:53.524 14:59:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:53.524 14:59:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:53.524 14:59:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.524 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:53.784 14:59:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:53.784 14:59:34 -- target/connect_stress.sh@34 -- # kill -0 3423285 00:11:53.784 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3423285) - No such process 00:11:53.784 14:59:34 -- target/connect_stress.sh@38 -- # wait 3423285 00:11:53.784 14:59:34 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:11:53.784 14:59:34 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:11:53.784 14:59:34 -- target/connect_stress.sh@43 -- # nvmftestfini 00:11:53.784 14:59:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:53.784 14:59:34 -- nvmf/common.sh@117 -- # sync 00:11:53.784 14:59:34 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:53.784 14:59:34 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:53.784 14:59:34 -- nvmf/common.sh@120 -- # set +e 00:11:53.784 14:59:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:53.784 14:59:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:53.784 rmmod nvme_rdma 00:11:53.784 rmmod nvme_fabrics 00:11:53.785 14:59:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:53.785 14:59:34 -- nvmf/common.sh@124 -- # set -e 00:11:53.785 14:59:34 -- nvmf/common.sh@125 -- # return 0 00:11:53.785 14:59:34 -- nvmf/common.sh@478 -- # '[' -n 3423163 ']' 00:11:53.785 14:59:34 -- nvmf/common.sh@479 -- # killprocess 3423163 00:11:53.785 14:59:34 -- common/autotest_common.sh@946 -- # '[' -z 3423163 ']' 00:11:53.785 14:59:34 -- common/autotest_common.sh@950 -- # kill -0 3423163 00:11:53.785 14:59:34 -- common/autotest_common.sh@951 -- # uname 00:11:54.045 14:59:34 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:54.045 14:59:34 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3423163 00:11:54.045 14:59:34 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:11:54.045 14:59:34 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:11:54.045 14:59:34 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3423163' 00:11:54.045 killing process with pid 3423163 00:11:54.045 14:59:34 -- common/autotest_common.sh@965 -- # kill 3423163 00:11:54.045 14:59:34 -- common/autotest_common.sh@970 -- # wait 3423163 00:11:54.045 [2024-04-26 14:59:34.859660] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:54.045 14:59:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:54.045 14:59:34 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:54.045 00:11:54.045 real 0m18.672s 00:11:54.045 user 0m42.130s 00:11:54.045 sys 0m6.569s 00:11:54.045 14:59:34 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:54.045 14:59:34 -- common/autotest_common.sh@10 -- # set +x 00:11:54.045 ************************************ 00:11:54.045 END TEST nvmf_connect_stress 00:11:54.045 ************************************ 00:11:54.306 14:59:35 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:11:54.306 14:59:35 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:54.306 14:59:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:54.306 14:59:35 -- common/autotest_common.sh@10 -- # set +x 00:11:54.306 ************************************ 00:11:54.306 START TEST nvmf_fused_ordering 00:11:54.306 ************************************ 00:11:54.306 14:59:35 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:11:54.568 * Looking for test storage... 00:11:54.568 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:54.568 14:59:35 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:54.568 14:59:35 -- nvmf/common.sh@7 -- # uname -s 00:11:54.568 14:59:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:54.568 14:59:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:54.568 14:59:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:54.568 14:59:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:54.568 14:59:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:54.568 14:59:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:54.568 14:59:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:54.568 14:59:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:54.568 14:59:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:54.568 14:59:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:54.568 14:59:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:54.568 14:59:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:11:54.568 14:59:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:54.568 14:59:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:54.568 14:59:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:54.568 14:59:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:54.568 14:59:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:54.568 14:59:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:54.568 14:59:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:54.568 14:59:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:54.568 14:59:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.568 14:59:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.568 14:59:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.568 14:59:35 -- paths/export.sh@5 -- # export PATH 00:11:54.568 14:59:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:54.568 14:59:35 -- nvmf/common.sh@47 -- # : 0 00:11:54.568 14:59:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:54.568 14:59:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:54.568 14:59:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:54.568 14:59:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:54.568 14:59:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:54.568 14:59:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:54.568 14:59:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:54.568 14:59:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:54.568 14:59:35 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:11:54.568 14:59:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:54.568 14:59:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:54.568 14:59:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:54.568 14:59:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:54.568 14:59:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:54.568 14:59:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:54.568 14:59:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:54.568 14:59:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:54.568 14:59:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:54.568 14:59:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:54.568 14:59:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:54.568 14:59:35 -- common/autotest_common.sh@10 -- # set +x 00:12:01.165 14:59:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:01.165 14:59:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:01.165 14:59:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:01.165 14:59:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:01.165 14:59:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:01.165 14:59:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:01.165 14:59:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:01.165 14:59:41 -- nvmf/common.sh@295 -- # net_devs=() 00:12:01.165 14:59:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:01.165 14:59:41 -- nvmf/common.sh@296 -- # e810=() 00:12:01.165 14:59:41 -- nvmf/common.sh@296 -- # local -ga e810 00:12:01.165 14:59:41 -- nvmf/common.sh@297 -- # x722=() 00:12:01.165 14:59:41 -- nvmf/common.sh@297 -- # local -ga x722 00:12:01.165 14:59:41 -- nvmf/common.sh@298 -- # mlx=() 00:12:01.165 14:59:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:01.165 14:59:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:01.165 14:59:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:01.165 14:59:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:01.165 14:59:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:12:01.165 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:12:01.165 14:59:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:01.165 14:59:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:01.165 14:59:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:12:01.165 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:12:01.165 14:59:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:01.165 14:59:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:01.165 14:59:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:01.165 14:59:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.165 14:59:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:01.165 14:59:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.165 14:59:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:12:01.165 Found net devices under 0000:31:00.0: mlx_0_0 00:12:01.165 14:59:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:01.165 14:59:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:01.165 14:59:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:01.165 14:59:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:01.165 14:59:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:12:01.165 Found net devices under 0000:31:00.1: mlx_0_1 00:12:01.165 14:59:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:01.165 14:59:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:01.165 14:59:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:01.165 14:59:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:01.165 14:59:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:01.165 14:59:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:01.165 14:59:41 -- nvmf/common.sh@58 -- # uname 00:12:01.165 14:59:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:01.165 14:59:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:01.165 14:59:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:01.165 14:59:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:01.165 14:59:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:01.165 14:59:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:01.165 14:59:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:01.165 14:59:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:01.165 14:59:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:01.165 14:59:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:01.165 14:59:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:01.165 14:59:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:01.165 14:59:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:01.165 14:59:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:01.165 14:59:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:01.165 14:59:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:01.166 14:59:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:01.166 14:59:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:01.166 14:59:41 -- nvmf/common.sh@105 -- # continue 2 00:12:01.166 14:59:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:01.166 14:59:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:01.166 14:59:41 -- nvmf/common.sh@105 -- # continue 2 00:12:01.166 14:59:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:01.166 14:59:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:01.166 14:59:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:01.166 14:59:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:01.166 14:59:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:01.166 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:01.166 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:12:01.166 altname enp49s0f0np0 00:12:01.166 altname ens786f0np0 00:12:01.166 inet 192.168.100.8/24 scope global mlx_0_0 00:12:01.166 valid_lft forever preferred_lft forever 00:12:01.166 14:59:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:01.166 14:59:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:01.166 14:59:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:01.166 14:59:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:01.166 14:59:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:01.166 14:59:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:01.166 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:01.166 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:12:01.166 altname enp49s0f1np1 00:12:01.166 altname ens786f1np1 00:12:01.166 inet 192.168.100.9/24 scope global mlx_0_1 00:12:01.166 valid_lft forever preferred_lft forever 00:12:01.166 14:59:41 -- nvmf/common.sh@411 -- # return 0 00:12:01.166 14:59:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:01.166 14:59:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:01.166 14:59:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:01.166 14:59:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:01.166 14:59:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:01.166 14:59:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:01.166 14:59:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:01.166 14:59:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:01.166 14:59:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:01.166 14:59:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:01.166 14:59:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:01.166 14:59:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:01.166 14:59:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:01.166 14:59:42 -- nvmf/common.sh@105 -- # continue 2 00:12:01.166 14:59:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:01.166 14:59:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:01.166 14:59:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:01.166 14:59:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:01.166 14:59:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:01.166 14:59:42 -- nvmf/common.sh@105 -- # continue 2 00:12:01.166 14:59:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:01.166 14:59:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:01.166 14:59:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:01.166 14:59:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:01.166 14:59:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:01.166 14:59:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:01.166 14:59:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:01.166 14:59:42 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:01.166 192.168.100.9' 00:12:01.166 14:59:42 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:01.166 192.168.100.9' 00:12:01.166 14:59:42 -- nvmf/common.sh@446 -- # head -n 1 00:12:01.166 14:59:42 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:01.166 14:59:42 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:01.166 192.168.100.9' 00:12:01.166 14:59:42 -- nvmf/common.sh@447 -- # tail -n +2 00:12:01.166 14:59:42 -- nvmf/common.sh@447 -- # head -n 1 00:12:01.166 14:59:42 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:01.166 14:59:42 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:01.166 14:59:42 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:01.166 14:59:42 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:01.166 14:59:42 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:01.166 14:59:42 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:01.166 14:59:42 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:12:01.166 14:59:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:01.166 14:59:42 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:01.166 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:12:01.166 14:59:42 -- nvmf/common.sh@470 -- # nvmfpid=3429163 00:12:01.166 14:59:42 -- nvmf/common.sh@471 -- # waitforlisten 3429163 00:12:01.167 14:59:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:01.167 14:59:42 -- common/autotest_common.sh@827 -- # '[' -z 3429163 ']' 00:12:01.167 14:59:42 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:01.167 14:59:42 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:01.167 14:59:42 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:01.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:01.167 14:59:42 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:01.167 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:12:01.429 [2024-04-26 14:59:42.145718] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:12:01.429 [2024-04-26 14:59:42.145785] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:01.429 EAL: No free 2048 kB hugepages reported on node 1 00:12:01.429 [2024-04-26 14:59:42.211247] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:01.429 [2024-04-26 14:59:42.284893] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:01.429 [2024-04-26 14:59:42.284932] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:01.429 [2024-04-26 14:59:42.284939] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:01.429 [2024-04-26 14:59:42.284946] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:01.429 [2024-04-26 14:59:42.284952] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:01.429 [2024-04-26 14:59:42.284972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:02.001 14:59:42 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:02.001 14:59:42 -- common/autotest_common.sh@860 -- # return 0 00:12:02.001 14:59:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:02.001 14:59:42 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:02.001 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 14:59:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:02.262 14:59:42 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:02.262 14:59:42 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 [2024-04-26 14:59:42.988551] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c43ca0/0x1c48190) succeed. 00:12:02.262 [2024-04-26 14:59:43.001662] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c451a0/0x1c89820) succeed. 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:02.262 14:59:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:02.262 14:59:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 [2024-04-26 14:59:43.061355] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:02.262 14:59:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 NULL1 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:12:02.262 14:59:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:02.262 14:59:43 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.262 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:12:02.262 14:59:43 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.262 14:59:43 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:12:02.262 [2024-04-26 14:59:43.116090] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:12:02.262 [2024-04-26 14:59:43.116152] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3429323 ] 00:12:02.262 EAL: No free 2048 kB hugepages reported on node 1 00:12:02.522 Attached to nqn.2016-06.io.spdk:cnode1 00:12:02.522 Namespace ID: 1 size: 1GB 00:12:02.522 fused_ordering(0) 00:12:02.522 fused_ordering(1) 00:12:02.522 fused_ordering(2) 00:12:02.522 fused_ordering(3) 00:12:02.522 fused_ordering(4) 00:12:02.522 fused_ordering(5) 00:12:02.522 fused_ordering(6) 00:12:02.522 fused_ordering(7) 00:12:02.522 fused_ordering(8) 00:12:02.522 fused_ordering(9) 00:12:02.522 fused_ordering(10) 00:12:02.522 fused_ordering(11) 00:12:02.522 fused_ordering(12) 00:12:02.522 fused_ordering(13) 00:12:02.522 fused_ordering(14) 00:12:02.522 fused_ordering(15) 00:12:02.522 fused_ordering(16) 00:12:02.522 fused_ordering(17) 00:12:02.522 fused_ordering(18) 00:12:02.522 fused_ordering(19) 00:12:02.522 fused_ordering(20) 00:12:02.522 fused_ordering(21) 00:12:02.522 fused_ordering(22) 00:12:02.522 fused_ordering(23) 00:12:02.522 fused_ordering(24) 00:12:02.522 fused_ordering(25) 00:12:02.522 fused_ordering(26) 00:12:02.522 fused_ordering(27) 00:12:02.522 fused_ordering(28) 00:12:02.522 fused_ordering(29) 00:12:02.522 fused_ordering(30) 00:12:02.522 fused_ordering(31) 00:12:02.522 fused_ordering(32) 00:12:02.522 fused_ordering(33) 00:12:02.522 fused_ordering(34) 00:12:02.522 fused_ordering(35) 00:12:02.522 fused_ordering(36) 00:12:02.522 fused_ordering(37) 00:12:02.522 fused_ordering(38) 00:12:02.522 fused_ordering(39) 00:12:02.522 fused_ordering(40) 00:12:02.522 fused_ordering(41) 00:12:02.522 fused_ordering(42) 00:12:02.522 fused_ordering(43) 00:12:02.522 fused_ordering(44) 00:12:02.522 fused_ordering(45) 00:12:02.522 fused_ordering(46) 00:12:02.522 fused_ordering(47) 00:12:02.522 fused_ordering(48) 00:12:02.522 fused_ordering(49) 00:12:02.522 fused_ordering(50) 00:12:02.522 fused_ordering(51) 00:12:02.522 fused_ordering(52) 00:12:02.522 fused_ordering(53) 00:12:02.522 fused_ordering(54) 00:12:02.522 fused_ordering(55) 00:12:02.522 fused_ordering(56) 00:12:02.522 fused_ordering(57) 00:12:02.522 fused_ordering(58) 00:12:02.522 fused_ordering(59) 00:12:02.522 fused_ordering(60) 00:12:02.522 fused_ordering(61) 00:12:02.522 fused_ordering(62) 00:12:02.522 fused_ordering(63) 00:12:02.522 fused_ordering(64) 00:12:02.522 fused_ordering(65) 00:12:02.522 fused_ordering(66) 00:12:02.522 fused_ordering(67) 00:12:02.522 fused_ordering(68) 00:12:02.522 fused_ordering(69) 00:12:02.522 fused_ordering(70) 00:12:02.522 fused_ordering(71) 00:12:02.522 fused_ordering(72) 00:12:02.522 fused_ordering(73) 00:12:02.522 fused_ordering(74) 00:12:02.522 fused_ordering(75) 00:12:02.522 fused_ordering(76) 00:12:02.522 fused_ordering(77) 00:12:02.522 fused_ordering(78) 00:12:02.522 fused_ordering(79) 00:12:02.522 fused_ordering(80) 00:12:02.522 fused_ordering(81) 00:12:02.522 fused_ordering(82) 00:12:02.522 fused_ordering(83) 00:12:02.522 fused_ordering(84) 00:12:02.522 fused_ordering(85) 00:12:02.522 fused_ordering(86) 00:12:02.522 fused_ordering(87) 00:12:02.522 fused_ordering(88) 00:12:02.522 fused_ordering(89) 00:12:02.522 fused_ordering(90) 00:12:02.522 fused_ordering(91) 00:12:02.522 fused_ordering(92) 00:12:02.522 fused_ordering(93) 00:12:02.522 fused_ordering(94) 00:12:02.522 fused_ordering(95) 00:12:02.522 fused_ordering(96) 00:12:02.522 fused_ordering(97) 00:12:02.522 fused_ordering(98) 00:12:02.522 fused_ordering(99) 00:12:02.522 fused_ordering(100) 00:12:02.522 fused_ordering(101) 00:12:02.522 fused_ordering(102) 00:12:02.522 fused_ordering(103) 00:12:02.522 fused_ordering(104) 00:12:02.522 fused_ordering(105) 00:12:02.523 fused_ordering(106) 00:12:02.523 fused_ordering(107) 00:12:02.523 fused_ordering(108) 00:12:02.523 fused_ordering(109) 00:12:02.523 fused_ordering(110) 00:12:02.523 fused_ordering(111) 00:12:02.523 fused_ordering(112) 00:12:02.523 fused_ordering(113) 00:12:02.523 fused_ordering(114) 00:12:02.523 fused_ordering(115) 00:12:02.523 fused_ordering(116) 00:12:02.523 fused_ordering(117) 00:12:02.523 fused_ordering(118) 00:12:02.523 fused_ordering(119) 00:12:02.523 fused_ordering(120) 00:12:02.523 fused_ordering(121) 00:12:02.523 fused_ordering(122) 00:12:02.523 fused_ordering(123) 00:12:02.523 fused_ordering(124) 00:12:02.523 fused_ordering(125) 00:12:02.523 fused_ordering(126) 00:12:02.523 fused_ordering(127) 00:12:02.523 fused_ordering(128) 00:12:02.523 fused_ordering(129) 00:12:02.523 fused_ordering(130) 00:12:02.523 fused_ordering(131) 00:12:02.523 fused_ordering(132) 00:12:02.523 fused_ordering(133) 00:12:02.523 fused_ordering(134) 00:12:02.523 fused_ordering(135) 00:12:02.523 fused_ordering(136) 00:12:02.523 fused_ordering(137) 00:12:02.523 fused_ordering(138) 00:12:02.523 fused_ordering(139) 00:12:02.523 fused_ordering(140) 00:12:02.523 fused_ordering(141) 00:12:02.523 fused_ordering(142) 00:12:02.523 fused_ordering(143) 00:12:02.523 fused_ordering(144) 00:12:02.523 fused_ordering(145) 00:12:02.523 fused_ordering(146) 00:12:02.523 fused_ordering(147) 00:12:02.523 fused_ordering(148) 00:12:02.523 fused_ordering(149) 00:12:02.523 fused_ordering(150) 00:12:02.523 fused_ordering(151) 00:12:02.523 fused_ordering(152) 00:12:02.523 fused_ordering(153) 00:12:02.523 fused_ordering(154) 00:12:02.523 fused_ordering(155) 00:12:02.523 fused_ordering(156) 00:12:02.523 fused_ordering(157) 00:12:02.523 fused_ordering(158) 00:12:02.523 fused_ordering(159) 00:12:02.523 fused_ordering(160) 00:12:02.523 fused_ordering(161) 00:12:02.523 fused_ordering(162) 00:12:02.523 fused_ordering(163) 00:12:02.523 fused_ordering(164) 00:12:02.523 fused_ordering(165) 00:12:02.523 fused_ordering(166) 00:12:02.523 fused_ordering(167) 00:12:02.523 fused_ordering(168) 00:12:02.523 fused_ordering(169) 00:12:02.523 fused_ordering(170) 00:12:02.523 fused_ordering(171) 00:12:02.523 fused_ordering(172) 00:12:02.523 fused_ordering(173) 00:12:02.523 fused_ordering(174) 00:12:02.523 fused_ordering(175) 00:12:02.523 fused_ordering(176) 00:12:02.523 fused_ordering(177) 00:12:02.523 fused_ordering(178) 00:12:02.523 fused_ordering(179) 00:12:02.523 fused_ordering(180) 00:12:02.523 fused_ordering(181) 00:12:02.523 fused_ordering(182) 00:12:02.523 fused_ordering(183) 00:12:02.523 fused_ordering(184) 00:12:02.523 fused_ordering(185) 00:12:02.523 fused_ordering(186) 00:12:02.523 fused_ordering(187) 00:12:02.523 fused_ordering(188) 00:12:02.523 fused_ordering(189) 00:12:02.523 fused_ordering(190) 00:12:02.523 fused_ordering(191) 00:12:02.523 fused_ordering(192) 00:12:02.523 fused_ordering(193) 00:12:02.523 fused_ordering(194) 00:12:02.523 fused_ordering(195) 00:12:02.523 fused_ordering(196) 00:12:02.523 fused_ordering(197) 00:12:02.523 fused_ordering(198) 00:12:02.523 fused_ordering(199) 00:12:02.523 fused_ordering(200) 00:12:02.523 fused_ordering(201) 00:12:02.523 fused_ordering(202) 00:12:02.523 fused_ordering(203) 00:12:02.523 fused_ordering(204) 00:12:02.523 fused_ordering(205) 00:12:02.523 fused_ordering(206) 00:12:02.523 fused_ordering(207) 00:12:02.523 fused_ordering(208) 00:12:02.523 fused_ordering(209) 00:12:02.523 fused_ordering(210) 00:12:02.523 fused_ordering(211) 00:12:02.523 fused_ordering(212) 00:12:02.523 fused_ordering(213) 00:12:02.523 fused_ordering(214) 00:12:02.523 fused_ordering(215) 00:12:02.523 fused_ordering(216) 00:12:02.523 fused_ordering(217) 00:12:02.523 fused_ordering(218) 00:12:02.523 fused_ordering(219) 00:12:02.523 fused_ordering(220) 00:12:02.523 fused_ordering(221) 00:12:02.523 fused_ordering(222) 00:12:02.523 fused_ordering(223) 00:12:02.523 fused_ordering(224) 00:12:02.523 fused_ordering(225) 00:12:02.523 fused_ordering(226) 00:12:02.523 fused_ordering(227) 00:12:02.523 fused_ordering(228) 00:12:02.523 fused_ordering(229) 00:12:02.523 fused_ordering(230) 00:12:02.523 fused_ordering(231) 00:12:02.523 fused_ordering(232) 00:12:02.523 fused_ordering(233) 00:12:02.523 fused_ordering(234) 00:12:02.523 fused_ordering(235) 00:12:02.523 fused_ordering(236) 00:12:02.523 fused_ordering(237) 00:12:02.523 fused_ordering(238) 00:12:02.523 fused_ordering(239) 00:12:02.523 fused_ordering(240) 00:12:02.523 fused_ordering(241) 00:12:02.523 fused_ordering(242) 00:12:02.523 fused_ordering(243) 00:12:02.523 fused_ordering(244) 00:12:02.523 fused_ordering(245) 00:12:02.523 fused_ordering(246) 00:12:02.523 fused_ordering(247) 00:12:02.523 fused_ordering(248) 00:12:02.523 fused_ordering(249) 00:12:02.523 fused_ordering(250) 00:12:02.523 fused_ordering(251) 00:12:02.523 fused_ordering(252) 00:12:02.523 fused_ordering(253) 00:12:02.523 fused_ordering(254) 00:12:02.523 fused_ordering(255) 00:12:02.523 fused_ordering(256) 00:12:02.523 fused_ordering(257) 00:12:02.523 fused_ordering(258) 00:12:02.523 fused_ordering(259) 00:12:02.523 fused_ordering(260) 00:12:02.523 fused_ordering(261) 00:12:02.523 fused_ordering(262) 00:12:02.523 fused_ordering(263) 00:12:02.523 fused_ordering(264) 00:12:02.523 fused_ordering(265) 00:12:02.523 fused_ordering(266) 00:12:02.523 fused_ordering(267) 00:12:02.523 fused_ordering(268) 00:12:02.523 fused_ordering(269) 00:12:02.523 fused_ordering(270) 00:12:02.523 fused_ordering(271) 00:12:02.523 fused_ordering(272) 00:12:02.523 fused_ordering(273) 00:12:02.523 fused_ordering(274) 00:12:02.523 fused_ordering(275) 00:12:02.523 fused_ordering(276) 00:12:02.523 fused_ordering(277) 00:12:02.523 fused_ordering(278) 00:12:02.523 fused_ordering(279) 00:12:02.523 fused_ordering(280) 00:12:02.523 fused_ordering(281) 00:12:02.523 fused_ordering(282) 00:12:02.523 fused_ordering(283) 00:12:02.523 fused_ordering(284) 00:12:02.523 fused_ordering(285) 00:12:02.523 fused_ordering(286) 00:12:02.523 fused_ordering(287) 00:12:02.523 fused_ordering(288) 00:12:02.523 fused_ordering(289) 00:12:02.523 fused_ordering(290) 00:12:02.523 fused_ordering(291) 00:12:02.523 fused_ordering(292) 00:12:02.523 fused_ordering(293) 00:12:02.523 fused_ordering(294) 00:12:02.523 fused_ordering(295) 00:12:02.523 fused_ordering(296) 00:12:02.523 fused_ordering(297) 00:12:02.523 fused_ordering(298) 00:12:02.523 fused_ordering(299) 00:12:02.523 fused_ordering(300) 00:12:02.523 fused_ordering(301) 00:12:02.523 fused_ordering(302) 00:12:02.523 fused_ordering(303) 00:12:02.523 fused_ordering(304) 00:12:02.523 fused_ordering(305) 00:12:02.523 fused_ordering(306) 00:12:02.523 fused_ordering(307) 00:12:02.523 fused_ordering(308) 00:12:02.523 fused_ordering(309) 00:12:02.523 fused_ordering(310) 00:12:02.523 fused_ordering(311) 00:12:02.523 fused_ordering(312) 00:12:02.523 fused_ordering(313) 00:12:02.523 fused_ordering(314) 00:12:02.523 fused_ordering(315) 00:12:02.523 fused_ordering(316) 00:12:02.523 fused_ordering(317) 00:12:02.523 fused_ordering(318) 00:12:02.523 fused_ordering(319) 00:12:02.523 fused_ordering(320) 00:12:02.523 fused_ordering(321) 00:12:02.523 fused_ordering(322) 00:12:02.523 fused_ordering(323) 00:12:02.523 fused_ordering(324) 00:12:02.523 fused_ordering(325) 00:12:02.523 fused_ordering(326) 00:12:02.523 fused_ordering(327) 00:12:02.523 fused_ordering(328) 00:12:02.523 fused_ordering(329) 00:12:02.523 fused_ordering(330) 00:12:02.523 fused_ordering(331) 00:12:02.523 fused_ordering(332) 00:12:02.523 fused_ordering(333) 00:12:02.523 fused_ordering(334) 00:12:02.523 fused_ordering(335) 00:12:02.523 fused_ordering(336) 00:12:02.523 fused_ordering(337) 00:12:02.523 fused_ordering(338) 00:12:02.523 fused_ordering(339) 00:12:02.523 fused_ordering(340) 00:12:02.523 fused_ordering(341) 00:12:02.523 fused_ordering(342) 00:12:02.523 fused_ordering(343) 00:12:02.523 fused_ordering(344) 00:12:02.523 fused_ordering(345) 00:12:02.523 fused_ordering(346) 00:12:02.523 fused_ordering(347) 00:12:02.523 fused_ordering(348) 00:12:02.523 fused_ordering(349) 00:12:02.523 fused_ordering(350) 00:12:02.523 fused_ordering(351) 00:12:02.523 fused_ordering(352) 00:12:02.523 fused_ordering(353) 00:12:02.523 fused_ordering(354) 00:12:02.523 fused_ordering(355) 00:12:02.523 fused_ordering(356) 00:12:02.523 fused_ordering(357) 00:12:02.523 fused_ordering(358) 00:12:02.523 fused_ordering(359) 00:12:02.523 fused_ordering(360) 00:12:02.523 fused_ordering(361) 00:12:02.523 fused_ordering(362) 00:12:02.523 fused_ordering(363) 00:12:02.523 fused_ordering(364) 00:12:02.523 fused_ordering(365) 00:12:02.523 fused_ordering(366) 00:12:02.523 fused_ordering(367) 00:12:02.523 fused_ordering(368) 00:12:02.523 fused_ordering(369) 00:12:02.523 fused_ordering(370) 00:12:02.523 fused_ordering(371) 00:12:02.523 fused_ordering(372) 00:12:02.523 fused_ordering(373) 00:12:02.523 fused_ordering(374) 00:12:02.523 fused_ordering(375) 00:12:02.523 fused_ordering(376) 00:12:02.523 fused_ordering(377) 00:12:02.523 fused_ordering(378) 00:12:02.523 fused_ordering(379) 00:12:02.523 fused_ordering(380) 00:12:02.523 fused_ordering(381) 00:12:02.523 fused_ordering(382) 00:12:02.523 fused_ordering(383) 00:12:02.523 fused_ordering(384) 00:12:02.523 fused_ordering(385) 00:12:02.523 fused_ordering(386) 00:12:02.523 fused_ordering(387) 00:12:02.523 fused_ordering(388) 00:12:02.523 fused_ordering(389) 00:12:02.523 fused_ordering(390) 00:12:02.523 fused_ordering(391) 00:12:02.523 fused_ordering(392) 00:12:02.523 fused_ordering(393) 00:12:02.523 fused_ordering(394) 00:12:02.523 fused_ordering(395) 00:12:02.523 fused_ordering(396) 00:12:02.523 fused_ordering(397) 00:12:02.523 fused_ordering(398) 00:12:02.523 fused_ordering(399) 00:12:02.523 fused_ordering(400) 00:12:02.523 fused_ordering(401) 00:12:02.523 fused_ordering(402) 00:12:02.523 fused_ordering(403) 00:12:02.523 fused_ordering(404) 00:12:02.523 fused_ordering(405) 00:12:02.523 fused_ordering(406) 00:12:02.523 fused_ordering(407) 00:12:02.523 fused_ordering(408) 00:12:02.523 fused_ordering(409) 00:12:02.523 fused_ordering(410) 00:12:02.784 fused_ordering(411) 00:12:02.784 fused_ordering(412) 00:12:02.784 fused_ordering(413) 00:12:02.784 fused_ordering(414) 00:12:02.784 fused_ordering(415) 00:12:02.784 fused_ordering(416) 00:12:02.784 fused_ordering(417) 00:12:02.784 fused_ordering(418) 00:12:02.784 fused_ordering(419) 00:12:02.784 fused_ordering(420) 00:12:02.784 fused_ordering(421) 00:12:02.784 fused_ordering(422) 00:12:02.784 fused_ordering(423) 00:12:02.784 fused_ordering(424) 00:12:02.784 fused_ordering(425) 00:12:02.784 fused_ordering(426) 00:12:02.784 fused_ordering(427) 00:12:02.784 fused_ordering(428) 00:12:02.784 fused_ordering(429) 00:12:02.784 fused_ordering(430) 00:12:02.784 fused_ordering(431) 00:12:02.784 fused_ordering(432) 00:12:02.784 fused_ordering(433) 00:12:02.784 fused_ordering(434) 00:12:02.784 fused_ordering(435) 00:12:02.784 fused_ordering(436) 00:12:02.784 fused_ordering(437) 00:12:02.784 fused_ordering(438) 00:12:02.784 fused_ordering(439) 00:12:02.784 fused_ordering(440) 00:12:02.784 fused_ordering(441) 00:12:02.784 fused_ordering(442) 00:12:02.784 fused_ordering(443) 00:12:02.784 fused_ordering(444) 00:12:02.784 fused_ordering(445) 00:12:02.784 fused_ordering(446) 00:12:02.784 fused_ordering(447) 00:12:02.784 fused_ordering(448) 00:12:02.784 fused_ordering(449) 00:12:02.784 fused_ordering(450) 00:12:02.784 fused_ordering(451) 00:12:02.784 fused_ordering(452) 00:12:02.784 fused_ordering(453) 00:12:02.784 fused_ordering(454) 00:12:02.784 fused_ordering(455) 00:12:02.784 fused_ordering(456) 00:12:02.784 fused_ordering(457) 00:12:02.784 fused_ordering(458) 00:12:02.784 fused_ordering(459) 00:12:02.784 fused_ordering(460) 00:12:02.784 fused_ordering(461) 00:12:02.784 fused_ordering(462) 00:12:02.784 fused_ordering(463) 00:12:02.784 fused_ordering(464) 00:12:02.784 fused_ordering(465) 00:12:02.784 fused_ordering(466) 00:12:02.784 fused_ordering(467) 00:12:02.784 fused_ordering(468) 00:12:02.784 fused_ordering(469) 00:12:02.784 fused_ordering(470) 00:12:02.784 fused_ordering(471) 00:12:02.784 fused_ordering(472) 00:12:02.784 fused_ordering(473) 00:12:02.784 fused_ordering(474) 00:12:02.784 fused_ordering(475) 00:12:02.784 fused_ordering(476) 00:12:02.784 fused_ordering(477) 00:12:02.784 fused_ordering(478) 00:12:02.784 fused_ordering(479) 00:12:02.784 fused_ordering(480) 00:12:02.784 fused_ordering(481) 00:12:02.784 fused_ordering(482) 00:12:02.784 fused_ordering(483) 00:12:02.784 fused_ordering(484) 00:12:02.784 fused_ordering(485) 00:12:02.784 fused_ordering(486) 00:12:02.784 fused_ordering(487) 00:12:02.784 fused_ordering(488) 00:12:02.784 fused_ordering(489) 00:12:02.784 fused_ordering(490) 00:12:02.784 fused_ordering(491) 00:12:02.784 fused_ordering(492) 00:12:02.784 fused_ordering(493) 00:12:02.784 fused_ordering(494) 00:12:02.784 fused_ordering(495) 00:12:02.784 fused_ordering(496) 00:12:02.784 fused_ordering(497) 00:12:02.784 fused_ordering(498) 00:12:02.784 fused_ordering(499) 00:12:02.784 fused_ordering(500) 00:12:02.784 fused_ordering(501) 00:12:02.784 fused_ordering(502) 00:12:02.784 fused_ordering(503) 00:12:02.784 fused_ordering(504) 00:12:02.784 fused_ordering(505) 00:12:02.784 fused_ordering(506) 00:12:02.784 fused_ordering(507) 00:12:02.784 fused_ordering(508) 00:12:02.784 fused_ordering(509) 00:12:02.784 fused_ordering(510) 00:12:02.784 fused_ordering(511) 00:12:02.784 fused_ordering(512) 00:12:02.784 fused_ordering(513) 00:12:02.784 fused_ordering(514) 00:12:02.784 fused_ordering(515) 00:12:02.784 fused_ordering(516) 00:12:02.784 fused_ordering(517) 00:12:02.784 fused_ordering(518) 00:12:02.784 fused_ordering(519) 00:12:02.784 fused_ordering(520) 00:12:02.784 fused_ordering(521) 00:12:02.784 fused_ordering(522) 00:12:02.784 fused_ordering(523) 00:12:02.784 fused_ordering(524) 00:12:02.784 fused_ordering(525) 00:12:02.784 fused_ordering(526) 00:12:02.784 fused_ordering(527) 00:12:02.784 fused_ordering(528) 00:12:02.784 fused_ordering(529) 00:12:02.784 fused_ordering(530) 00:12:02.784 fused_ordering(531) 00:12:02.784 fused_ordering(532) 00:12:02.784 fused_ordering(533) 00:12:02.784 fused_ordering(534) 00:12:02.784 fused_ordering(535) 00:12:02.784 fused_ordering(536) 00:12:02.784 fused_ordering(537) 00:12:02.784 fused_ordering(538) 00:12:02.784 fused_ordering(539) 00:12:02.784 fused_ordering(540) 00:12:02.784 fused_ordering(541) 00:12:02.784 fused_ordering(542) 00:12:02.784 fused_ordering(543) 00:12:02.785 fused_ordering(544) 00:12:02.785 fused_ordering(545) 00:12:02.785 fused_ordering(546) 00:12:02.785 fused_ordering(547) 00:12:02.785 fused_ordering(548) 00:12:02.785 fused_ordering(549) 00:12:02.785 fused_ordering(550) 00:12:02.785 fused_ordering(551) 00:12:02.785 fused_ordering(552) 00:12:02.785 fused_ordering(553) 00:12:02.785 fused_ordering(554) 00:12:02.785 fused_ordering(555) 00:12:02.785 fused_ordering(556) 00:12:02.785 fused_ordering(557) 00:12:02.785 fused_ordering(558) 00:12:02.785 fused_ordering(559) 00:12:02.785 fused_ordering(560) 00:12:02.785 fused_ordering(561) 00:12:02.785 fused_ordering(562) 00:12:02.785 fused_ordering(563) 00:12:02.785 fused_ordering(564) 00:12:02.785 fused_ordering(565) 00:12:02.785 fused_ordering(566) 00:12:02.785 fused_ordering(567) 00:12:02.785 fused_ordering(568) 00:12:02.785 fused_ordering(569) 00:12:02.785 fused_ordering(570) 00:12:02.785 fused_ordering(571) 00:12:02.785 fused_ordering(572) 00:12:02.785 fused_ordering(573) 00:12:02.785 fused_ordering(574) 00:12:02.785 fused_ordering(575) 00:12:02.785 fused_ordering(576) 00:12:02.785 fused_ordering(577) 00:12:02.785 fused_ordering(578) 00:12:02.785 fused_ordering(579) 00:12:02.785 fused_ordering(580) 00:12:02.785 fused_ordering(581) 00:12:02.785 fused_ordering(582) 00:12:02.785 fused_ordering(583) 00:12:02.785 fused_ordering(584) 00:12:02.785 fused_ordering(585) 00:12:02.785 fused_ordering(586) 00:12:02.785 fused_ordering(587) 00:12:02.785 fused_ordering(588) 00:12:02.785 fused_ordering(589) 00:12:02.785 fused_ordering(590) 00:12:02.785 fused_ordering(591) 00:12:02.785 fused_ordering(592) 00:12:02.785 fused_ordering(593) 00:12:02.785 fused_ordering(594) 00:12:02.785 fused_ordering(595) 00:12:02.785 fused_ordering(596) 00:12:02.785 fused_ordering(597) 00:12:02.785 fused_ordering(598) 00:12:02.785 fused_ordering(599) 00:12:02.785 fused_ordering(600) 00:12:02.785 fused_ordering(601) 00:12:02.785 fused_ordering(602) 00:12:02.785 fused_ordering(603) 00:12:02.785 fused_ordering(604) 00:12:02.785 fused_ordering(605) 00:12:02.785 fused_ordering(606) 00:12:02.785 fused_ordering(607) 00:12:02.785 fused_ordering(608) 00:12:02.785 fused_ordering(609) 00:12:02.785 fused_ordering(610) 00:12:02.785 fused_ordering(611) 00:12:02.785 fused_ordering(612) 00:12:02.785 fused_ordering(613) 00:12:02.785 fused_ordering(614) 00:12:02.785 fused_ordering(615) 00:12:02.785 fused_ordering(616) 00:12:02.785 fused_ordering(617) 00:12:02.785 fused_ordering(618) 00:12:02.785 fused_ordering(619) 00:12:02.785 fused_ordering(620) 00:12:02.785 fused_ordering(621) 00:12:02.785 fused_ordering(622) 00:12:02.785 fused_ordering(623) 00:12:02.785 fused_ordering(624) 00:12:02.785 fused_ordering(625) 00:12:02.785 fused_ordering(626) 00:12:02.785 fused_ordering(627) 00:12:02.785 fused_ordering(628) 00:12:02.785 fused_ordering(629) 00:12:02.785 fused_ordering(630) 00:12:02.785 fused_ordering(631) 00:12:02.785 fused_ordering(632) 00:12:02.785 fused_ordering(633) 00:12:02.785 fused_ordering(634) 00:12:02.785 fused_ordering(635) 00:12:02.785 fused_ordering(636) 00:12:02.785 fused_ordering(637) 00:12:02.785 fused_ordering(638) 00:12:02.785 fused_ordering(639) 00:12:02.785 fused_ordering(640) 00:12:02.785 fused_ordering(641) 00:12:02.785 fused_ordering(642) 00:12:02.785 fused_ordering(643) 00:12:02.785 fused_ordering(644) 00:12:02.785 fused_ordering(645) 00:12:02.785 fused_ordering(646) 00:12:02.785 fused_ordering(647) 00:12:02.785 fused_ordering(648) 00:12:02.785 fused_ordering(649) 00:12:02.785 fused_ordering(650) 00:12:02.785 fused_ordering(651) 00:12:02.785 fused_ordering(652) 00:12:02.785 fused_ordering(653) 00:12:02.785 fused_ordering(654) 00:12:02.785 fused_ordering(655) 00:12:02.785 fused_ordering(656) 00:12:02.785 fused_ordering(657) 00:12:02.785 fused_ordering(658) 00:12:02.785 fused_ordering(659) 00:12:02.785 fused_ordering(660) 00:12:02.785 fused_ordering(661) 00:12:02.785 fused_ordering(662) 00:12:02.785 fused_ordering(663) 00:12:02.785 fused_ordering(664) 00:12:02.785 fused_ordering(665) 00:12:02.785 fused_ordering(666) 00:12:02.785 fused_ordering(667) 00:12:02.785 fused_ordering(668) 00:12:02.785 fused_ordering(669) 00:12:02.785 fused_ordering(670) 00:12:02.785 fused_ordering(671) 00:12:02.785 fused_ordering(672) 00:12:02.785 fused_ordering(673) 00:12:02.785 fused_ordering(674) 00:12:02.785 fused_ordering(675) 00:12:02.785 fused_ordering(676) 00:12:02.785 fused_ordering(677) 00:12:02.785 fused_ordering(678) 00:12:02.785 fused_ordering(679) 00:12:02.785 fused_ordering(680) 00:12:02.785 fused_ordering(681) 00:12:02.785 fused_ordering(682) 00:12:02.785 fused_ordering(683) 00:12:02.785 fused_ordering(684) 00:12:02.785 fused_ordering(685) 00:12:02.785 fused_ordering(686) 00:12:02.785 fused_ordering(687) 00:12:02.785 fused_ordering(688) 00:12:02.785 fused_ordering(689) 00:12:02.785 fused_ordering(690) 00:12:02.785 fused_ordering(691) 00:12:02.785 fused_ordering(692) 00:12:02.785 fused_ordering(693) 00:12:02.785 fused_ordering(694) 00:12:02.785 fused_ordering(695) 00:12:02.785 fused_ordering(696) 00:12:02.785 fused_ordering(697) 00:12:02.785 fused_ordering(698) 00:12:02.785 fused_ordering(699) 00:12:02.785 fused_ordering(700) 00:12:02.785 fused_ordering(701) 00:12:02.785 fused_ordering(702) 00:12:02.785 fused_ordering(703) 00:12:02.785 fused_ordering(704) 00:12:02.785 fused_ordering(705) 00:12:02.785 fused_ordering(706) 00:12:02.785 fused_ordering(707) 00:12:02.785 fused_ordering(708) 00:12:02.785 fused_ordering(709) 00:12:02.785 fused_ordering(710) 00:12:02.785 fused_ordering(711) 00:12:02.785 fused_ordering(712) 00:12:02.785 fused_ordering(713) 00:12:02.785 fused_ordering(714) 00:12:02.785 fused_ordering(715) 00:12:02.785 fused_ordering(716) 00:12:02.785 fused_ordering(717) 00:12:02.785 fused_ordering(718) 00:12:02.785 fused_ordering(719) 00:12:02.785 fused_ordering(720) 00:12:02.785 fused_ordering(721) 00:12:02.785 fused_ordering(722) 00:12:02.785 fused_ordering(723) 00:12:02.785 fused_ordering(724) 00:12:02.785 fused_ordering(725) 00:12:02.785 fused_ordering(726) 00:12:02.785 fused_ordering(727) 00:12:02.785 fused_ordering(728) 00:12:02.785 fused_ordering(729) 00:12:02.785 fused_ordering(730) 00:12:02.785 fused_ordering(731) 00:12:02.785 fused_ordering(732) 00:12:02.785 fused_ordering(733) 00:12:02.785 fused_ordering(734) 00:12:02.785 fused_ordering(735) 00:12:02.785 fused_ordering(736) 00:12:02.785 fused_ordering(737) 00:12:02.785 fused_ordering(738) 00:12:02.785 fused_ordering(739) 00:12:02.785 fused_ordering(740) 00:12:02.785 fused_ordering(741) 00:12:02.785 fused_ordering(742) 00:12:02.785 fused_ordering(743) 00:12:02.785 fused_ordering(744) 00:12:02.785 fused_ordering(745) 00:12:02.785 fused_ordering(746) 00:12:02.785 fused_ordering(747) 00:12:02.785 fused_ordering(748) 00:12:02.785 fused_ordering(749) 00:12:02.785 fused_ordering(750) 00:12:02.785 fused_ordering(751) 00:12:02.785 fused_ordering(752) 00:12:02.785 fused_ordering(753) 00:12:02.785 fused_ordering(754) 00:12:02.785 fused_ordering(755) 00:12:02.785 fused_ordering(756) 00:12:02.785 fused_ordering(757) 00:12:02.785 fused_ordering(758) 00:12:02.785 fused_ordering(759) 00:12:02.785 fused_ordering(760) 00:12:02.785 fused_ordering(761) 00:12:02.785 fused_ordering(762) 00:12:02.785 fused_ordering(763) 00:12:02.785 fused_ordering(764) 00:12:02.785 fused_ordering(765) 00:12:02.785 fused_ordering(766) 00:12:02.785 fused_ordering(767) 00:12:02.785 fused_ordering(768) 00:12:02.785 fused_ordering(769) 00:12:02.785 fused_ordering(770) 00:12:02.785 fused_ordering(771) 00:12:02.785 fused_ordering(772) 00:12:02.785 fused_ordering(773) 00:12:02.785 fused_ordering(774) 00:12:02.785 fused_ordering(775) 00:12:02.785 fused_ordering(776) 00:12:02.785 fused_ordering(777) 00:12:02.785 fused_ordering(778) 00:12:02.785 fused_ordering(779) 00:12:02.785 fused_ordering(780) 00:12:02.785 fused_ordering(781) 00:12:02.785 fused_ordering(782) 00:12:02.785 fused_ordering(783) 00:12:02.785 fused_ordering(784) 00:12:02.785 fused_ordering(785) 00:12:02.785 fused_ordering(786) 00:12:02.785 fused_ordering(787) 00:12:02.785 fused_ordering(788) 00:12:02.785 fused_ordering(789) 00:12:02.785 fused_ordering(790) 00:12:02.785 fused_ordering(791) 00:12:02.785 fused_ordering(792) 00:12:02.785 fused_ordering(793) 00:12:02.785 fused_ordering(794) 00:12:02.785 fused_ordering(795) 00:12:02.785 fused_ordering(796) 00:12:02.785 fused_ordering(797) 00:12:02.785 fused_ordering(798) 00:12:02.785 fused_ordering(799) 00:12:02.785 fused_ordering(800) 00:12:02.785 fused_ordering(801) 00:12:02.785 fused_ordering(802) 00:12:02.785 fused_ordering(803) 00:12:02.785 fused_ordering(804) 00:12:02.785 fused_ordering(805) 00:12:02.785 fused_ordering(806) 00:12:02.785 fused_ordering(807) 00:12:02.785 fused_ordering(808) 00:12:02.785 fused_ordering(809) 00:12:02.785 fused_ordering(810) 00:12:02.785 fused_ordering(811) 00:12:02.785 fused_ordering(812) 00:12:02.785 fused_ordering(813) 00:12:02.785 fused_ordering(814) 00:12:02.785 fused_ordering(815) 00:12:02.785 fused_ordering(816) 00:12:02.785 fused_ordering(817) 00:12:02.785 fused_ordering(818) 00:12:02.785 fused_ordering(819) 00:12:02.785 fused_ordering(820) 00:12:03.046 fused_ordering(821) 00:12:03.046 fused_ordering(822) 00:12:03.046 fused_ordering(823) 00:12:03.046 fused_ordering(824) 00:12:03.046 fused_ordering(825) 00:12:03.046 fused_ordering(826) 00:12:03.046 fused_ordering(827) 00:12:03.046 fused_ordering(828) 00:12:03.046 fused_ordering(829) 00:12:03.046 fused_ordering(830) 00:12:03.046 fused_ordering(831) 00:12:03.046 fused_ordering(832) 00:12:03.046 fused_ordering(833) 00:12:03.046 fused_ordering(834) 00:12:03.046 fused_ordering(835) 00:12:03.046 fused_ordering(836) 00:12:03.046 fused_ordering(837) 00:12:03.046 fused_ordering(838) 00:12:03.046 fused_ordering(839) 00:12:03.046 fused_ordering(840) 00:12:03.046 fused_ordering(841) 00:12:03.046 fused_ordering(842) 00:12:03.046 fused_ordering(843) 00:12:03.046 fused_ordering(844) 00:12:03.046 fused_ordering(845) 00:12:03.046 fused_ordering(846) 00:12:03.046 fused_ordering(847) 00:12:03.046 fused_ordering(848) 00:12:03.046 fused_ordering(849) 00:12:03.046 fused_ordering(850) 00:12:03.046 fused_ordering(851) 00:12:03.046 fused_ordering(852) 00:12:03.046 fused_ordering(853) 00:12:03.046 fused_ordering(854) 00:12:03.046 fused_ordering(855) 00:12:03.046 fused_ordering(856) 00:12:03.046 fused_ordering(857) 00:12:03.046 fused_ordering(858) 00:12:03.046 fused_ordering(859) 00:12:03.046 fused_ordering(860) 00:12:03.046 fused_ordering(861) 00:12:03.046 fused_ordering(862) 00:12:03.046 fused_ordering(863) 00:12:03.046 fused_ordering(864) 00:12:03.046 fused_ordering(865) 00:12:03.046 fused_ordering(866) 00:12:03.046 fused_ordering(867) 00:12:03.046 fused_ordering(868) 00:12:03.046 fused_ordering(869) 00:12:03.046 fused_ordering(870) 00:12:03.046 fused_ordering(871) 00:12:03.046 fused_ordering(872) 00:12:03.046 fused_ordering(873) 00:12:03.046 fused_ordering(874) 00:12:03.046 fused_ordering(875) 00:12:03.046 fused_ordering(876) 00:12:03.046 fused_ordering(877) 00:12:03.046 fused_ordering(878) 00:12:03.046 fused_ordering(879) 00:12:03.046 fused_ordering(880) 00:12:03.046 fused_ordering(881) 00:12:03.046 fused_ordering(882) 00:12:03.046 fused_ordering(883) 00:12:03.046 fused_ordering(884) 00:12:03.046 fused_ordering(885) 00:12:03.046 fused_ordering(886) 00:12:03.046 fused_ordering(887) 00:12:03.046 fused_ordering(888) 00:12:03.046 fused_ordering(889) 00:12:03.046 fused_ordering(890) 00:12:03.046 fused_ordering(891) 00:12:03.046 fused_ordering(892) 00:12:03.046 fused_ordering(893) 00:12:03.046 fused_ordering(894) 00:12:03.046 fused_ordering(895) 00:12:03.046 fused_ordering(896) 00:12:03.046 fused_ordering(897) 00:12:03.046 fused_ordering(898) 00:12:03.046 fused_ordering(899) 00:12:03.046 fused_ordering(900) 00:12:03.046 fused_ordering(901) 00:12:03.046 fused_ordering(902) 00:12:03.046 fused_ordering(903) 00:12:03.046 fused_ordering(904) 00:12:03.046 fused_ordering(905) 00:12:03.046 fused_ordering(906) 00:12:03.046 fused_ordering(907) 00:12:03.046 fused_ordering(908) 00:12:03.046 fused_ordering(909) 00:12:03.046 fused_ordering(910) 00:12:03.046 fused_ordering(911) 00:12:03.046 fused_ordering(912) 00:12:03.046 fused_ordering(913) 00:12:03.046 fused_ordering(914) 00:12:03.046 fused_ordering(915) 00:12:03.046 fused_ordering(916) 00:12:03.046 fused_ordering(917) 00:12:03.046 fused_ordering(918) 00:12:03.046 fused_ordering(919) 00:12:03.046 fused_ordering(920) 00:12:03.046 fused_ordering(921) 00:12:03.046 fused_ordering(922) 00:12:03.046 fused_ordering(923) 00:12:03.046 fused_ordering(924) 00:12:03.046 fused_ordering(925) 00:12:03.046 fused_ordering(926) 00:12:03.046 fused_ordering(927) 00:12:03.046 fused_ordering(928) 00:12:03.046 fused_ordering(929) 00:12:03.046 fused_ordering(930) 00:12:03.046 fused_ordering(931) 00:12:03.046 fused_ordering(932) 00:12:03.046 fused_ordering(933) 00:12:03.046 fused_ordering(934) 00:12:03.046 fused_ordering(935) 00:12:03.046 fused_ordering(936) 00:12:03.046 fused_ordering(937) 00:12:03.046 fused_ordering(938) 00:12:03.046 fused_ordering(939) 00:12:03.046 fused_ordering(940) 00:12:03.046 fused_ordering(941) 00:12:03.046 fused_ordering(942) 00:12:03.046 fused_ordering(943) 00:12:03.046 fused_ordering(944) 00:12:03.046 fused_ordering(945) 00:12:03.046 fused_ordering(946) 00:12:03.046 fused_ordering(947) 00:12:03.046 fused_ordering(948) 00:12:03.046 fused_ordering(949) 00:12:03.046 fused_ordering(950) 00:12:03.046 fused_ordering(951) 00:12:03.046 fused_ordering(952) 00:12:03.046 fused_ordering(953) 00:12:03.046 fused_ordering(954) 00:12:03.046 fused_ordering(955) 00:12:03.046 fused_ordering(956) 00:12:03.046 fused_ordering(957) 00:12:03.046 fused_ordering(958) 00:12:03.046 fused_ordering(959) 00:12:03.046 fused_ordering(960) 00:12:03.046 fused_ordering(961) 00:12:03.046 fused_ordering(962) 00:12:03.046 fused_ordering(963) 00:12:03.046 fused_ordering(964) 00:12:03.046 fused_ordering(965) 00:12:03.046 fused_ordering(966) 00:12:03.046 fused_ordering(967) 00:12:03.046 fused_ordering(968) 00:12:03.046 fused_ordering(969) 00:12:03.046 fused_ordering(970) 00:12:03.046 fused_ordering(971) 00:12:03.046 fused_ordering(972) 00:12:03.046 fused_ordering(973) 00:12:03.046 fused_ordering(974) 00:12:03.046 fused_ordering(975) 00:12:03.046 fused_ordering(976) 00:12:03.046 fused_ordering(977) 00:12:03.046 fused_ordering(978) 00:12:03.046 fused_ordering(979) 00:12:03.046 fused_ordering(980) 00:12:03.046 fused_ordering(981) 00:12:03.046 fused_ordering(982) 00:12:03.047 fused_ordering(983) 00:12:03.047 fused_ordering(984) 00:12:03.047 fused_ordering(985) 00:12:03.047 fused_ordering(986) 00:12:03.047 fused_ordering(987) 00:12:03.047 fused_ordering(988) 00:12:03.047 fused_ordering(989) 00:12:03.047 fused_ordering(990) 00:12:03.047 fused_ordering(991) 00:12:03.047 fused_ordering(992) 00:12:03.047 fused_ordering(993) 00:12:03.047 fused_ordering(994) 00:12:03.047 fused_ordering(995) 00:12:03.047 fused_ordering(996) 00:12:03.047 fused_ordering(997) 00:12:03.047 fused_ordering(998) 00:12:03.047 fused_ordering(999) 00:12:03.047 fused_ordering(1000) 00:12:03.047 fused_ordering(1001) 00:12:03.047 fused_ordering(1002) 00:12:03.047 fused_ordering(1003) 00:12:03.047 fused_ordering(1004) 00:12:03.047 fused_ordering(1005) 00:12:03.047 fused_ordering(1006) 00:12:03.047 fused_ordering(1007) 00:12:03.047 fused_ordering(1008) 00:12:03.047 fused_ordering(1009) 00:12:03.047 fused_ordering(1010) 00:12:03.047 fused_ordering(1011) 00:12:03.047 fused_ordering(1012) 00:12:03.047 fused_ordering(1013) 00:12:03.047 fused_ordering(1014) 00:12:03.047 fused_ordering(1015) 00:12:03.047 fused_ordering(1016) 00:12:03.047 fused_ordering(1017) 00:12:03.047 fused_ordering(1018) 00:12:03.047 fused_ordering(1019) 00:12:03.047 fused_ordering(1020) 00:12:03.047 fused_ordering(1021) 00:12:03.047 fused_ordering(1022) 00:12:03.047 fused_ordering(1023) 00:12:03.047 14:59:43 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:12:03.047 14:59:43 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:12:03.047 14:59:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:03.047 14:59:43 -- nvmf/common.sh@117 -- # sync 00:12:03.047 14:59:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:03.047 14:59:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:03.047 14:59:43 -- nvmf/common.sh@120 -- # set +e 00:12:03.047 14:59:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:03.047 14:59:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:03.047 rmmod nvme_rdma 00:12:03.307 rmmod nvme_fabrics 00:12:03.307 14:59:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:03.307 14:59:44 -- nvmf/common.sh@124 -- # set -e 00:12:03.307 14:59:44 -- nvmf/common.sh@125 -- # return 0 00:12:03.307 14:59:44 -- nvmf/common.sh@478 -- # '[' -n 3429163 ']' 00:12:03.307 14:59:44 -- nvmf/common.sh@479 -- # killprocess 3429163 00:12:03.307 14:59:44 -- common/autotest_common.sh@946 -- # '[' -z 3429163 ']' 00:12:03.307 14:59:44 -- common/autotest_common.sh@950 -- # kill -0 3429163 00:12:03.307 14:59:44 -- common/autotest_common.sh@951 -- # uname 00:12:03.307 14:59:44 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:03.307 14:59:44 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3429163 00:12:03.307 14:59:44 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:12:03.307 14:59:44 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:12:03.307 14:59:44 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3429163' 00:12:03.307 killing process with pid 3429163 00:12:03.307 14:59:44 -- common/autotest_common.sh@965 -- # kill 3429163 00:12:03.307 14:59:44 -- common/autotest_common.sh@970 -- # wait 3429163 00:12:03.307 [2024-04-26 14:59:44.133060] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:03.568 14:59:44 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:03.568 14:59:44 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:03.568 00:12:03.568 real 0m9.082s 00:12:03.568 user 0m5.078s 00:12:03.568 sys 0m5.356s 00:12:03.568 14:59:44 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:03.568 14:59:44 -- common/autotest_common.sh@10 -- # set +x 00:12:03.568 ************************************ 00:12:03.568 END TEST nvmf_fused_ordering 00:12:03.568 ************************************ 00:12:03.568 14:59:44 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:12:03.568 14:59:44 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:03.568 14:59:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:03.568 14:59:44 -- common/autotest_common.sh@10 -- # set +x 00:12:03.568 ************************************ 00:12:03.568 START TEST nvmf_delete_subsystem 00:12:03.568 ************************************ 00:12:03.568 14:59:44 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:12:03.830 * Looking for test storage... 00:12:03.830 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:03.830 14:59:44 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:03.830 14:59:44 -- nvmf/common.sh@7 -- # uname -s 00:12:03.830 14:59:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:03.830 14:59:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:03.830 14:59:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:03.830 14:59:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:03.830 14:59:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:03.830 14:59:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:03.830 14:59:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:03.830 14:59:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:03.830 14:59:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:03.830 14:59:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:03.830 14:59:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:03.830 14:59:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:03.830 14:59:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:03.830 14:59:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:03.830 14:59:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:03.830 14:59:44 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:03.830 14:59:44 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:03.830 14:59:44 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:03.830 14:59:44 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:03.830 14:59:44 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:03.830 14:59:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.830 14:59:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.830 14:59:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.830 14:59:44 -- paths/export.sh@5 -- # export PATH 00:12:03.830 14:59:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.830 14:59:44 -- nvmf/common.sh@47 -- # : 0 00:12:03.830 14:59:44 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:03.830 14:59:44 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:03.830 14:59:44 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:03.830 14:59:44 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:03.830 14:59:44 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:03.830 14:59:44 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:03.830 14:59:44 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:03.830 14:59:44 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:03.830 14:59:44 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:12:03.830 14:59:44 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:03.830 14:59:44 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:03.830 14:59:44 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:03.830 14:59:44 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:03.830 14:59:44 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:03.830 14:59:44 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:03.830 14:59:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:03.830 14:59:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:03.830 14:59:44 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:03.830 14:59:44 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:03.830 14:59:44 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:03.830 14:59:44 -- common/autotest_common.sh@10 -- # set +x 00:12:10.536 14:59:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:10.536 14:59:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:10.536 14:59:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:10.536 14:59:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:10.536 14:59:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:10.536 14:59:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:10.536 14:59:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:10.536 14:59:50 -- nvmf/common.sh@295 -- # net_devs=() 00:12:10.536 14:59:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:10.536 14:59:50 -- nvmf/common.sh@296 -- # e810=() 00:12:10.536 14:59:50 -- nvmf/common.sh@296 -- # local -ga e810 00:12:10.536 14:59:50 -- nvmf/common.sh@297 -- # x722=() 00:12:10.536 14:59:50 -- nvmf/common.sh@297 -- # local -ga x722 00:12:10.536 14:59:50 -- nvmf/common.sh@298 -- # mlx=() 00:12:10.536 14:59:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:10.536 14:59:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:10.536 14:59:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:12:10.536 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:12:10.536 14:59:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:10.536 14:59:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:12:10.536 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:12:10.536 14:59:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:10.536 14:59:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:10.536 14:59:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:10.536 14:59:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:12:10.536 Found net devices under 0000:31:00.0: mlx_0_0 00:12:10.536 14:59:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:10.536 14:59:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:10.536 14:59:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:12:10.536 Found net devices under 0000:31:00.1: mlx_0_1 00:12:10.536 14:59:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:10.536 14:59:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:10.536 14:59:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:10.536 14:59:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:10.536 14:59:50 -- nvmf/common.sh@58 -- # uname 00:12:10.536 14:59:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:10.536 14:59:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:10.536 14:59:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:10.536 14:59:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:10.536 14:59:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:10.536 14:59:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:10.536 14:59:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:10.536 14:59:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:10.536 14:59:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:10.536 14:59:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:10.536 14:59:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:10.536 14:59:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:10.536 14:59:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:10.536 14:59:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:10.536 14:59:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:10.536 14:59:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:10.536 14:59:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:10.536 14:59:50 -- nvmf/common.sh@105 -- # continue 2 00:12:10.536 14:59:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.536 14:59:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:10.536 14:59:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:10.536 14:59:50 -- nvmf/common.sh@105 -- # continue 2 00:12:10.536 14:59:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:10.536 14:59:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:10.536 14:59:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:10.536 14:59:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:10.536 14:59:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:10.536 14:59:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:10.536 14:59:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:10.536 14:59:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:10.536 14:59:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:10.536 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:10.536 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:12:10.536 altname enp49s0f0np0 00:12:10.536 altname ens786f0np0 00:12:10.536 inet 192.168.100.8/24 scope global mlx_0_0 00:12:10.536 valid_lft forever preferred_lft forever 00:12:10.536 14:59:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:10.536 14:59:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:10.536 14:59:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:10.536 14:59:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:10.536 14:59:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:10.536 14:59:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:10.536 14:59:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:10.536 14:59:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:10.536 14:59:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:10.536 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:10.536 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:12:10.536 altname enp49s0f1np1 00:12:10.536 altname ens786f1np1 00:12:10.536 inet 192.168.100.9/24 scope global mlx_0_1 00:12:10.537 valid_lft forever preferred_lft forever 00:12:10.537 14:59:51 -- nvmf/common.sh@411 -- # return 0 00:12:10.537 14:59:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:10.537 14:59:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:10.537 14:59:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:10.537 14:59:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:10.537 14:59:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:10.537 14:59:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:10.537 14:59:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:10.537 14:59:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:10.537 14:59:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:10.537 14:59:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:10.537 14:59:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:10.537 14:59:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.537 14:59:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:10.537 14:59:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:10.537 14:59:51 -- nvmf/common.sh@105 -- # continue 2 00:12:10.537 14:59:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:10.537 14:59:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.537 14:59:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:10.537 14:59:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:10.537 14:59:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:10.537 14:59:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:10.537 14:59:51 -- nvmf/common.sh@105 -- # continue 2 00:12:10.537 14:59:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:10.537 14:59:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:10.537 14:59:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:10.537 14:59:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:10.537 14:59:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:10.537 14:59:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:10.537 14:59:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:10.537 14:59:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:10.537 192.168.100.9' 00:12:10.537 14:59:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:10.537 192.168.100.9' 00:12:10.537 14:59:51 -- nvmf/common.sh@446 -- # head -n 1 00:12:10.537 14:59:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:10.537 14:59:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:10.537 192.168.100.9' 00:12:10.537 14:59:51 -- nvmf/common.sh@447 -- # tail -n +2 00:12:10.537 14:59:51 -- nvmf/common.sh@447 -- # head -n 1 00:12:10.537 14:59:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:10.537 14:59:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:10.537 14:59:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:10.537 14:59:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:10.537 14:59:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:10.537 14:59:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:10.537 14:59:51 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:12:10.537 14:59:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:10.537 14:59:51 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:10.537 14:59:51 -- common/autotest_common.sh@10 -- # set +x 00:12:10.537 14:59:51 -- nvmf/common.sh@470 -- # nvmfpid=3433312 00:12:10.537 14:59:51 -- nvmf/common.sh@471 -- # waitforlisten 3433312 00:12:10.537 14:59:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:12:10.537 14:59:51 -- common/autotest_common.sh@827 -- # '[' -z 3433312 ']' 00:12:10.537 14:59:51 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:10.537 14:59:51 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:10.537 14:59:51 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:10.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:10.537 14:59:51 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:10.537 14:59:51 -- common/autotest_common.sh@10 -- # set +x 00:12:10.537 [2024-04-26 14:59:51.189416] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:12:10.537 [2024-04-26 14:59:51.189489] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:10.537 EAL: No free 2048 kB hugepages reported on node 1 00:12:10.537 [2024-04-26 14:59:51.253642] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:12:10.537 [2024-04-26 14:59:51.325984] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:10.537 [2024-04-26 14:59:51.326022] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:10.537 [2024-04-26 14:59:51.326029] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:10.537 [2024-04-26 14:59:51.326035] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:10.537 [2024-04-26 14:59:51.326041] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:10.537 [2024-04-26 14:59:51.326155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:10.537 [2024-04-26 14:59:51.326160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:11.107 14:59:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:11.107 14:59:51 -- common/autotest_common.sh@860 -- # return 0 00:12:11.107 14:59:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:11.107 14:59:51 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:11.107 14:59:51 -- common/autotest_common.sh@10 -- # set +x 00:12:11.107 14:59:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:11.107 14:59:52 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:11.107 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.107 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.107 [2024-04-26 14:59:52.050059] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x88a540/0x88ea30) succeed. 00:12:11.368 [2024-04-26 14:59:52.062168] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x88ba40/0x8d00c0) succeed. 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:11.368 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.368 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:11.368 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.368 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.368 [2024-04-26 14:59:52.150707] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:11.368 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.368 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.368 NULL1 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:11.368 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.368 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.368 Delay0 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:11.368 14:59:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:11.368 14:59:52 -- common/autotest_common.sh@10 -- # set +x 00:12:11.368 14:59:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@28 -- # perf_pid=3433430 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@30 -- # sleep 2 00:12:11.368 14:59:52 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:11.368 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.368 [2024-04-26 14:59:52.259437] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:13.279 14:59:54 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:13.279 14:59:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:13.279 14:59:54 -- common/autotest_common.sh@10 -- # set +x 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 NVMe io qpair process completion error 00:12:14.662 14:59:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:14.662 14:59:55 -- target/delete_subsystem.sh@34 -- # delay=0 00:12:14.662 14:59:55 -- target/delete_subsystem.sh@35 -- # kill -0 3433430 00:12:14.662 14:59:55 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:14.922 14:59:55 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:14.922 14:59:55 -- target/delete_subsystem.sh@35 -- # kill -0 3433430 00:12:14.922 14:59:55 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:15.495 Write completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Write completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Write completed with error (sct=0, sc=8) 00:12:15.495 starting I/O failed: -6 00:12:15.495 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Read completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.496 Write completed with error (sct=0, sc=8) 00:12:15.496 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 starting I/O failed: -6 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Write completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 Read completed with error (sct=0, sc=8) 00:12:15.497 14:59:56 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:15.497 14:59:56 -- target/delete_subsystem.sh@35 -- # kill -0 3433430 00:12:15.497 14:59:56 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:12:15.497 [2024-04-26 14:59:56.363762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:12:15.497 [2024-04-26 14:59:56.363791] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:12:15.497 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:12:15.497 Initializing NVMe Controllers 00:12:15.497 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:15.497 Controller IO queue size 128, less than required. 00:12:15.497 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:15.497 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:15.497 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:15.497 Initialization complete. Launching workers. 00:12:15.497 ======================================================== 00:12:15.497 Latency(us) 00:12:15.497 Device Information : IOPS MiB/s Average min max 00:12:15.497 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.62 0.04 1591786.05 1000140.47 2969679.65 00:12:15.497 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.62 0.04 1593054.94 1000977.22 2969683.92 00:12:15.497 ======================================================== 00:12:15.497 Total : 161.24 0.08 1592420.49 1000140.47 2969683.92 00:12:15.497 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@35 -- # kill -0 3433430 00:12:16.068 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3433430) - No such process 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@45 -- # NOT wait 3433430 00:12:16.068 14:59:56 -- common/autotest_common.sh@648 -- # local es=0 00:12:16.068 14:59:56 -- common/autotest_common.sh@650 -- # valid_exec_arg wait 3433430 00:12:16.068 14:59:56 -- common/autotest_common.sh@636 -- # local arg=wait 00:12:16.068 14:59:56 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:16.068 14:59:56 -- common/autotest_common.sh@640 -- # type -t wait 00:12:16.068 14:59:56 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:16.068 14:59:56 -- common/autotest_common.sh@651 -- # wait 3433430 00:12:16.068 14:59:56 -- common/autotest_common.sh@651 -- # es=1 00:12:16.068 14:59:56 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:16.068 14:59:56 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:16.068 14:59:56 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:16.068 14:59:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:16.068 14:59:56 -- common/autotest_common.sh@10 -- # set +x 00:12:16.068 14:59:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:16.068 14:59:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:16.068 14:59:56 -- common/autotest_common.sh@10 -- # set +x 00:12:16.068 [2024-04-26 14:59:56.884082] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:16.068 14:59:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.068 14:59:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:16.068 14:59:56 -- common/autotest_common.sh@10 -- # set +x 00:12:16.068 14:59:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@54 -- # perf_pid=3434353 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@56 -- # delay=0 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:16.068 14:59:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:16.068 EAL: No free 2048 kB hugepages reported on node 1 00:12:16.068 [2024-04-26 14:59:56.975120] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:12:16.640 14:59:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:16.640 14:59:57 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:16.640 14:59:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:17.210 14:59:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:17.211 14:59:57 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:17.211 14:59:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:17.472 14:59:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:17.472 14:59:58 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:17.472 14:59:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:18.045 14:59:58 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:18.045 14:59:58 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:18.045 14:59:58 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:18.616 14:59:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:18.616 14:59:59 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:18.616 14:59:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:19.191 14:59:59 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:19.191 14:59:59 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:19.191 14:59:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:19.765 15:00:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:19.765 15:00:00 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:19.765 15:00:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:20.027 15:00:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:20.027 15:00:00 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:20.027 15:00:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:20.600 15:00:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:20.600 15:00:01 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:20.600 15:00:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:21.175 15:00:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:21.175 15:00:01 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:21.175 15:00:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:21.745 15:00:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:21.745 15:00:02 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:21.745 15:00:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:22.008 15:00:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:22.008 15:00:02 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:22.008 15:00:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:22.581 15:00:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:22.581 15:00:03 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:22.581 15:00:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:23.152 15:00:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:23.152 15:00:03 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:23.152 15:00:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:12:23.413 Initializing NVMe Controllers 00:12:23.413 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:12:23.413 Controller IO queue size 128, less than required. 00:12:23.413 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:23.413 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:12:23.413 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:12:23.413 Initialization complete. Launching workers. 00:12:23.413 ======================================================== 00:12:23.413 Latency(us) 00:12:23.413 Device Information : IOPS MiB/s Average min max 00:12:23.413 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1002845.68 1000117.08 1006686.22 00:12:23.413 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1001536.85 1000057.62 1004202.91 00:12:23.413 ======================================================== 00:12:23.413 Total : 256.00 0.12 1002191.26 1000057.62 1006686.22 00:12:23.413 00:12:23.673 15:00:04 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:12:23.673 15:00:04 -- target/delete_subsystem.sh@57 -- # kill -0 3434353 00:12:23.673 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3434353) - No such process 00:12:23.673 15:00:04 -- target/delete_subsystem.sh@67 -- # wait 3434353 00:12:23.673 15:00:04 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:12:23.673 15:00:04 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:12:23.673 15:00:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:23.673 15:00:04 -- nvmf/common.sh@117 -- # sync 00:12:23.673 15:00:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:23.673 15:00:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:23.673 15:00:04 -- nvmf/common.sh@120 -- # set +e 00:12:23.673 15:00:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:23.673 15:00:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:23.673 rmmod nvme_rdma 00:12:23.673 rmmod nvme_fabrics 00:12:23.673 15:00:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:23.673 15:00:04 -- nvmf/common.sh@124 -- # set -e 00:12:23.673 15:00:04 -- nvmf/common.sh@125 -- # return 0 00:12:23.673 15:00:04 -- nvmf/common.sh@478 -- # '[' -n 3433312 ']' 00:12:23.673 15:00:04 -- nvmf/common.sh@479 -- # killprocess 3433312 00:12:23.673 15:00:04 -- common/autotest_common.sh@946 -- # '[' -z 3433312 ']' 00:12:23.673 15:00:04 -- common/autotest_common.sh@950 -- # kill -0 3433312 00:12:23.673 15:00:04 -- common/autotest_common.sh@951 -- # uname 00:12:23.673 15:00:04 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:23.673 15:00:04 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3433312 00:12:23.673 15:00:04 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:12:23.673 15:00:04 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:12:23.673 15:00:04 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3433312' 00:12:23.673 killing process with pid 3433312 00:12:23.673 15:00:04 -- common/autotest_common.sh@965 -- # kill 3433312 00:12:23.673 15:00:04 -- common/autotest_common.sh@970 -- # wait 3433312 00:12:23.934 [2024-04-26 15:00:04.630254] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:23.934 15:00:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:23.934 15:00:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:23.934 00:12:23.934 real 0m20.319s 00:12:23.934 user 0m50.031s 00:12:23.934 sys 0m5.927s 00:12:23.934 15:00:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:23.934 15:00:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.934 ************************************ 00:12:23.934 END TEST nvmf_delete_subsystem 00:12:23.934 ************************************ 00:12:23.934 15:00:04 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:12:23.934 15:00:04 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:23.934 15:00:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:23.934 15:00:04 -- common/autotest_common.sh@10 -- # set +x 00:12:24.194 ************************************ 00:12:24.194 START TEST nvmf_ns_masking 00:12:24.194 ************************************ 00:12:24.194 15:00:04 -- common/autotest_common.sh@1121 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:12:24.194 * Looking for test storage... 00:12:24.194 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:24.194 15:00:05 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:24.194 15:00:05 -- nvmf/common.sh@7 -- # uname -s 00:12:24.194 15:00:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:24.194 15:00:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:24.194 15:00:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:24.194 15:00:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:24.194 15:00:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:24.194 15:00:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:24.194 15:00:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:24.194 15:00:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:24.194 15:00:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:24.194 15:00:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:24.194 15:00:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:24.194 15:00:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:24.194 15:00:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:24.194 15:00:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:24.194 15:00:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:24.194 15:00:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:24.194 15:00:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:24.194 15:00:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:24.194 15:00:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:24.194 15:00:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:24.194 15:00:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.194 15:00:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.194 15:00:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.194 15:00:05 -- paths/export.sh@5 -- # export PATH 00:12:24.194 15:00:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.194 15:00:05 -- nvmf/common.sh@47 -- # : 0 00:12:24.194 15:00:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:24.194 15:00:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:24.194 15:00:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:24.194 15:00:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:24.194 15:00:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:24.194 15:00:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:24.194 15:00:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:24.194 15:00:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:24.194 15:00:05 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:24.194 15:00:05 -- target/ns_masking.sh@11 -- # loops=5 00:12:24.194 15:00:05 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:12:24.194 15:00:05 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:12:24.194 15:00:05 -- target/ns_masking.sh@15 -- # uuidgen 00:12:24.194 15:00:05 -- target/ns_masking.sh@15 -- # HOSTID=dc3cd905-3b71-4e6b-890f-2943289d23b9 00:12:24.194 15:00:05 -- target/ns_masking.sh@44 -- # nvmftestinit 00:12:24.194 15:00:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:24.194 15:00:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:24.194 15:00:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:24.194 15:00:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:24.194 15:00:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:24.194 15:00:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:24.194 15:00:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:24.195 15:00:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.195 15:00:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:24.195 15:00:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:24.195 15:00:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:24.195 15:00:05 -- common/autotest_common.sh@10 -- # set +x 00:12:32.336 15:00:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:32.336 15:00:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:32.336 15:00:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:32.336 15:00:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:32.336 15:00:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:32.336 15:00:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:32.336 15:00:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:32.336 15:00:11 -- nvmf/common.sh@295 -- # net_devs=() 00:12:32.336 15:00:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:32.336 15:00:11 -- nvmf/common.sh@296 -- # e810=() 00:12:32.336 15:00:11 -- nvmf/common.sh@296 -- # local -ga e810 00:12:32.336 15:00:11 -- nvmf/common.sh@297 -- # x722=() 00:12:32.336 15:00:11 -- nvmf/common.sh@297 -- # local -ga x722 00:12:32.336 15:00:11 -- nvmf/common.sh@298 -- # mlx=() 00:12:32.336 15:00:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:32.336 15:00:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:32.336 15:00:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:32.337 15:00:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:32.337 15:00:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:12:32.337 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:12:32.337 15:00:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:32.337 15:00:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:12:32.337 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:12:32.337 15:00:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:32.337 15:00:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.337 15:00:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.337 15:00:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:12:32.337 Found net devices under 0000:31:00.0: mlx_0_0 00:12:32.337 15:00:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:32.337 15:00:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:32.337 15:00:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:12:32.337 Found net devices under 0000:31:00.1: mlx_0_1 00:12:32.337 15:00:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:32.337 15:00:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:32.337 15:00:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:32.337 15:00:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:32.337 15:00:11 -- nvmf/common.sh@58 -- # uname 00:12:32.337 15:00:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:32.337 15:00:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:32.337 15:00:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:32.337 15:00:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:32.337 15:00:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:32.337 15:00:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:32.337 15:00:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:32.337 15:00:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:32.337 15:00:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:32.337 15:00:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:32.337 15:00:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:32.337 15:00:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:32.337 15:00:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:32.337 15:00:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:32.337 15:00:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:32.337 15:00:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:32.337 15:00:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:32.337 15:00:11 -- nvmf/common.sh@105 -- # continue 2 00:12:32.337 15:00:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:32.337 15:00:11 -- nvmf/common.sh@105 -- # continue 2 00:12:32.337 15:00:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:32.337 15:00:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:32.337 15:00:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:32.337 15:00:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:32.337 15:00:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:32.337 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:32.337 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:12:32.337 altname enp49s0f0np0 00:12:32.337 altname ens786f0np0 00:12:32.337 inet 192.168.100.8/24 scope global mlx_0_0 00:12:32.337 valid_lft forever preferred_lft forever 00:12:32.337 15:00:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:32.337 15:00:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:32.337 15:00:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:32.337 15:00:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:32.337 15:00:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:32.337 15:00:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:32.337 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:32.337 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:12:32.337 altname enp49s0f1np1 00:12:32.337 altname ens786f1np1 00:12:32.337 inet 192.168.100.9/24 scope global mlx_0_1 00:12:32.337 valid_lft forever preferred_lft forever 00:12:32.337 15:00:11 -- nvmf/common.sh@411 -- # return 0 00:12:32.337 15:00:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:32.337 15:00:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:32.337 15:00:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:32.337 15:00:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:32.337 15:00:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:32.337 15:00:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:32.337 15:00:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:32.337 15:00:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:32.337 15:00:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:32.337 15:00:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:32.337 15:00:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:32.337 15:00:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:32.337 15:00:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:32.337 15:00:12 -- nvmf/common.sh@105 -- # continue 2 00:12:32.337 15:00:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:32.337 15:00:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:32.337 15:00:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:32.337 15:00:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:32.337 15:00:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:32.337 15:00:12 -- nvmf/common.sh@105 -- # continue 2 00:12:32.337 15:00:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:32.337 15:00:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:32.337 15:00:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:32.337 15:00:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:32.337 15:00:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:32.337 15:00:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:32.337 15:00:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:32.338 15:00:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:32.338 15:00:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:32.338 15:00:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:32.338 15:00:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:32.338 15:00:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:32.338 15:00:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:32.338 192.168.100.9' 00:12:32.338 15:00:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:32.338 192.168.100.9' 00:12:32.338 15:00:12 -- nvmf/common.sh@446 -- # head -n 1 00:12:32.338 15:00:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:32.338 15:00:12 -- nvmf/common.sh@447 -- # head -n 1 00:12:32.338 15:00:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:32.338 192.168.100.9' 00:12:32.338 15:00:12 -- nvmf/common.sh@447 -- # tail -n +2 00:12:32.338 15:00:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:32.338 15:00:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:32.338 15:00:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:32.338 15:00:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:32.338 15:00:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:32.338 15:00:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:32.338 15:00:12 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:12:32.338 15:00:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:32.338 15:00:12 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:32.338 15:00:12 -- common/autotest_common.sh@10 -- # set +x 00:12:32.338 15:00:12 -- nvmf/common.sh@470 -- # nvmfpid=3440264 00:12:32.338 15:00:12 -- nvmf/common.sh@471 -- # waitforlisten 3440264 00:12:32.338 15:00:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:32.338 15:00:12 -- common/autotest_common.sh@827 -- # '[' -z 3440264 ']' 00:12:32.338 15:00:12 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:32.338 15:00:12 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:32.338 15:00:12 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:32.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:32.338 15:00:12 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:32.338 15:00:12 -- common/autotest_common.sh@10 -- # set +x 00:12:32.338 [2024-04-26 15:00:12.151865] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:12:32.338 [2024-04-26 15:00:12.151917] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:32.338 EAL: No free 2048 kB hugepages reported on node 1 00:12:32.338 [2024-04-26 15:00:12.211539] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:32.338 [2024-04-26 15:00:12.276312] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:32.338 [2024-04-26 15:00:12.276352] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:32.338 [2024-04-26 15:00:12.276361] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:32.338 [2024-04-26 15:00:12.276369] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:32.338 [2024-04-26 15:00:12.276379] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:32.338 [2024-04-26 15:00:12.276513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:32.338 [2024-04-26 15:00:12.276633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:32.338 [2024-04-26 15:00:12.276759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:32.338 [2024-04-26 15:00:12.276761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:32.338 15:00:12 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:32.338 15:00:12 -- common/autotest_common.sh@860 -- # return 0 00:12:32.338 15:00:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:32.338 15:00:12 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:32.338 15:00:12 -- common/autotest_common.sh@10 -- # set +x 00:12:32.338 15:00:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:32.338 15:00:12 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:32.338 [2024-04-26 15:00:13.139148] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc8ab00/0xc8eff0) succeed. 00:12:32.338 [2024-04-26 15:00:13.152413] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc8c140/0xcd0680) succeed. 00:12:32.598 15:00:13 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:12:32.598 15:00:13 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:12:32.598 15:00:13 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:12:32.598 Malloc1 00:12:32.598 15:00:13 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:12:32.857 Malloc2 00:12:32.857 15:00:13 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:32.857 15:00:13 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:12:33.118 15:00:13 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:33.378 [2024-04-26 15:00:14.074899] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:33.378 15:00:14 -- target/ns_masking.sh@61 -- # connect 00:12:33.378 15:00:14 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I dc3cd905-3b71-4e6b-890f-2943289d23b9 -a 192.168.100.8 -s 4420 -i 4 00:12:34.763 15:00:15 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:12:34.763 15:00:15 -- common/autotest_common.sh@1194 -- # local i=0 00:12:34.763 15:00:15 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:12:34.763 15:00:15 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:12:34.763 15:00:15 -- common/autotest_common.sh@1201 -- # sleep 2 00:12:37.313 15:00:17 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:12:37.313 15:00:17 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:12:37.313 15:00:17 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:12:37.313 15:00:17 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:12:37.313 15:00:17 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:12:37.313 15:00:17 -- common/autotest_common.sh@1204 -- # return 0 00:12:37.313 15:00:17 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:12:37.313 15:00:17 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:12:37.313 15:00:17 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:12:37.313 15:00:17 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:12:37.313 15:00:17 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:37.313 [ 0]:0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:37.313 15:00:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:37.313 15:00:17 -- target/ns_masking.sh@40 -- # nguid=c29d29e6ad744e159b62e85db9bac4fe 00:12:37.313 15:00:17 -- target/ns_masking.sh@41 -- # [[ c29d29e6ad744e159b62e85db9bac4fe != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:37.313 15:00:17 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:12:37.313 15:00:17 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:37.313 [ 0]:0x1 00:12:37.313 15:00:17 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:37.313 15:00:17 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:37.313 15:00:18 -- target/ns_masking.sh@40 -- # nguid=c29d29e6ad744e159b62e85db9bac4fe 00:12:37.313 15:00:18 -- target/ns_masking.sh@41 -- # [[ c29d29e6ad744e159b62e85db9bac4fe != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:37.313 15:00:18 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:12:37.313 15:00:18 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:37.313 15:00:18 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:37.313 [ 1]:0x2 00:12:37.313 15:00:18 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:37.313 15:00:18 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:37.313 15:00:18 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:37.313 15:00:18 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:37.313 15:00:18 -- target/ns_masking.sh@69 -- # disconnect 00:12:37.314 15:00:18 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:38.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.254 15:00:19 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.514 15:00:19 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:12:38.514 15:00:19 -- target/ns_masking.sh@77 -- # connect 1 00:12:38.514 15:00:19 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I dc3cd905-3b71-4e6b-890f-2943289d23b9 -a 192.168.100.8 -s 4420 -i 4 00:12:40.426 15:00:20 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:12:40.426 15:00:20 -- common/autotest_common.sh@1194 -- # local i=0 00:12:40.426 15:00:20 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:12:40.426 15:00:20 -- common/autotest_common.sh@1196 -- # [[ -n 1 ]] 00:12:40.426 15:00:20 -- common/autotest_common.sh@1197 -- # nvme_device_counter=1 00:12:40.426 15:00:20 -- common/autotest_common.sh@1201 -- # sleep 2 00:12:42.339 15:00:22 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:12:42.339 15:00:22 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:12:42.339 15:00:22 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:12:42.339 15:00:22 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:12:42.339 15:00:22 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:12:42.339 15:00:22 -- common/autotest_common.sh@1204 -- # return 0 00:12:42.339 15:00:22 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:12:42.339 15:00:22 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:12:42.339 15:00:23 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:12:42.339 15:00:23 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:12:42.339 15:00:23 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:12:42.339 15:00:23 -- common/autotest_common.sh@648 -- # local es=0 00:12:42.339 15:00:23 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:12:42.339 15:00:23 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:12:42.339 15:00:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:42.339 15:00:23 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:12:42.339 15:00:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:42.339 15:00:23 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:12:42.339 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:42.339 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:12:42.339 15:00:23 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.339 15:00:23 -- common/autotest_common.sh@651 -- # es=1 00:12:42.339 15:00:23 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:42.339 15:00:23 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:42.339 15:00:23 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:42.339 15:00:23 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:12:42.339 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.339 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:42.339 [ 0]:0x2 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.339 15:00:23 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:42.339 15:00:23 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.339 15:00:23 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:12:42.599 15:00:23 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:12:42.599 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.599 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:42.599 [ 0]:0x1 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # nguid=c29d29e6ad744e159b62e85db9bac4fe 00:12:42.599 15:00:23 -- target/ns_masking.sh@41 -- # [[ c29d29e6ad744e159b62e85db9bac4fe != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.599 15:00:23 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:12:42.599 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.599 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:42.599 [ 1]:0x2 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.599 15:00:23 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:42.599 15:00:23 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.599 15:00:23 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:12:42.860 15:00:23 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:12:42.861 15:00:23 -- common/autotest_common.sh@648 -- # local es=0 00:12:42.861 15:00:23 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:12:42.861 15:00:23 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:12:42.861 15:00:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:42.861 15:00:23 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:12:42.861 15:00:23 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:42.861 15:00:23 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:12:42.861 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.861 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:12:42.861 15:00:23 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.861 15:00:23 -- common/autotest_common.sh@651 -- # es=1 00:12:42.861 15:00:23 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:42.861 15:00:23 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:42.861 15:00:23 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:42.861 15:00:23 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:12:42.861 15:00:23 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:42.861 15:00:23 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:42.861 [ 0]:0x2 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:42.861 15:00:23 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:42.861 15:00:23 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:42.861 15:00:23 -- target/ns_masking.sh@91 -- # disconnect 00:12:42.861 15:00:23 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:44.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.249 15:00:24 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:12:44.249 15:00:24 -- target/ns_masking.sh@95 -- # connect 2 00:12:44.249 15:00:24 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I dc3cd905-3b71-4e6b-890f-2943289d23b9 -a 192.168.100.8 -s 4420 -i 4 00:12:45.748 15:00:26 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:12:45.748 15:00:26 -- common/autotest_common.sh@1194 -- # local i=0 00:12:45.748 15:00:26 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:12:45.748 15:00:26 -- common/autotest_common.sh@1196 -- # [[ -n 2 ]] 00:12:45.748 15:00:26 -- common/autotest_common.sh@1197 -- # nvme_device_counter=2 00:12:45.748 15:00:26 -- common/autotest_common.sh@1201 -- # sleep 2 00:12:47.659 15:00:28 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:12:47.659 15:00:28 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:12:47.659 15:00:28 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:12:47.659 15:00:28 -- common/autotest_common.sh@1203 -- # nvme_devices=2 00:12:47.659 15:00:28 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:12:47.659 15:00:28 -- common/autotest_common.sh@1204 -- # return 0 00:12:47.659 15:00:28 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:12:47.659 15:00:28 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:12:47.659 15:00:28 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:12:47.659 15:00:28 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:12:47.659 15:00:28 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:12:47.659 15:00:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:47.659 15:00:28 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:47.659 [ 0]:0x1 00:12:47.659 15:00:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:47.659 15:00:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:47.659 15:00:28 -- target/ns_masking.sh@40 -- # nguid=c29d29e6ad744e159b62e85db9bac4fe 00:12:47.659 15:00:28 -- target/ns_masking.sh@41 -- # [[ c29d29e6ad744e159b62e85db9bac4fe != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:47.659 15:00:28 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:12:47.659 15:00:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:47.659 15:00:28 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:47.659 [ 1]:0x2 00:12:47.659 15:00:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:47.659 15:00:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:47.919 15:00:28 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:47.919 15:00:28 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:12:47.919 15:00:28 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:12:47.919 15:00:28 -- common/autotest_common.sh@648 -- # local es=0 00:12:47.919 15:00:28 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:12:47.919 15:00:28 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:12:47.919 15:00:28 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:47.919 15:00:28 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:12:47.919 15:00:28 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:47.919 15:00:28 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:12:47.919 15:00:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:47.919 15:00:28 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:12:47.919 15:00:28 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:47.919 15:00:28 -- common/autotest_common.sh@651 -- # es=1 00:12:47.919 15:00:28 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:47.919 15:00:28 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:47.919 15:00:28 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:47.919 15:00:28 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:12:47.919 15:00:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:47.919 15:00:28 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:47.919 [ 0]:0x2 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:47.919 15:00:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:48.180 15:00:28 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:48.180 15:00:28 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:48.180 15:00:28 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:12:48.180 15:00:28 -- common/autotest_common.sh@648 -- # local es=0 00:12:48.180 15:00:28 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:12:48.180 15:00:28 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.180 15:00:28 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.180 15:00:28 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.180 15:00:28 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.180 15:00:28 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.180 15:00:28 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.180 15:00:28 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.180 15:00:28 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:12:48.180 15:00:28 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:12:48.180 [2024-04-26 15:00:29.035790] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:12:48.180 request: 00:12:48.180 { 00:12:48.180 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:12:48.180 "nsid": 2, 00:12:48.180 "host": "nqn.2016-06.io.spdk:host1", 00:12:48.180 "method": "nvmf_ns_remove_host", 00:12:48.180 "req_id": 1 00:12:48.180 } 00:12:48.180 Got JSON-RPC error response 00:12:48.180 response: 00:12:48.180 { 00:12:48.180 "code": -32602, 00:12:48.180 "message": "Invalid parameters" 00:12:48.180 } 00:12:48.180 15:00:29 -- common/autotest_common.sh@651 -- # es=1 00:12:48.180 15:00:29 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:48.180 15:00:29 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:48.180 15:00:29 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:48.180 15:00:29 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:12:48.180 15:00:29 -- common/autotest_common.sh@648 -- # local es=0 00:12:48.180 15:00:29 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:12:48.180 15:00:29 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:12:48.180 15:00:29 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.180 15:00:29 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:12:48.180 15:00:29 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.180 15:00:29 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:12:48.181 15:00:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:48.181 15:00:29 -- target/ns_masking.sh@39 -- # grep 0x1 00:12:48.181 15:00:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:12:48.181 15:00:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:48.181 15:00:29 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:12:48.181 15:00:29 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:48.181 15:00:29 -- common/autotest_common.sh@651 -- # es=1 00:12:48.181 15:00:29 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:48.181 15:00:29 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:48.181 15:00:29 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:48.181 15:00:29 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:12:48.181 15:00:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:12:48.181 15:00:29 -- target/ns_masking.sh@39 -- # grep 0x2 00:12:48.441 [ 0]:0x2 00:12:48.441 15:00:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:12:48.441 15:00:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:12:48.441 15:00:29 -- target/ns_masking.sh@40 -- # nguid=1f26abf23c914a42a5fdd7b01918eb66 00:12:48.441 15:00:29 -- target/ns_masking.sh@41 -- # [[ 1f26abf23c914a42a5fdd7b01918eb66 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:12:48.441 15:00:29 -- target/ns_masking.sh@108 -- # disconnect 00:12:48.441 15:00:29 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:49.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:49.384 15:00:30 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:49.646 15:00:30 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:12:49.646 15:00:30 -- target/ns_masking.sh@114 -- # nvmftestfini 00:12:49.646 15:00:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:49.646 15:00:30 -- nvmf/common.sh@117 -- # sync 00:12:49.646 15:00:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:49.646 15:00:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:49.646 15:00:30 -- nvmf/common.sh@120 -- # set +e 00:12:49.646 15:00:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:49.646 15:00:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:49.646 rmmod nvme_rdma 00:12:49.646 rmmod nvme_fabrics 00:12:49.646 15:00:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:49.646 15:00:30 -- nvmf/common.sh@124 -- # set -e 00:12:49.646 15:00:30 -- nvmf/common.sh@125 -- # return 0 00:12:49.646 15:00:30 -- nvmf/common.sh@478 -- # '[' -n 3440264 ']' 00:12:49.646 15:00:30 -- nvmf/common.sh@479 -- # killprocess 3440264 00:12:49.646 15:00:30 -- common/autotest_common.sh@946 -- # '[' -z 3440264 ']' 00:12:49.646 15:00:30 -- common/autotest_common.sh@950 -- # kill -0 3440264 00:12:49.646 15:00:30 -- common/autotest_common.sh@951 -- # uname 00:12:49.646 15:00:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:49.646 15:00:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3440264 00:12:49.646 15:00:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:12:49.646 15:00:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:12:49.646 15:00:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3440264' 00:12:49.646 killing process with pid 3440264 00:12:49.646 15:00:30 -- common/autotest_common.sh@965 -- # kill 3440264 00:12:49.646 15:00:30 -- common/autotest_common.sh@970 -- # wait 3440264 00:12:49.906 [2024-04-26 15:00:30.652112] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:49.906 15:00:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:49.906 15:00:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:49.906 00:12:49.906 real 0m25.854s 00:12:49.906 user 1m18.682s 00:12:49.906 sys 0m6.465s 00:12:49.906 15:00:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:49.906 15:00:30 -- common/autotest_common.sh@10 -- # set +x 00:12:49.906 ************************************ 00:12:49.906 END TEST nvmf_ns_masking 00:12:49.906 ************************************ 00:12:49.906 15:00:30 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:12:49.906 15:00:30 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:12:49.906 15:00:30 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:49.906 15:00:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:49.906 15:00:30 -- common/autotest_common.sh@10 -- # set +x 00:12:50.167 ************************************ 00:12:50.167 START TEST nvmf_nvme_cli 00:12:50.167 ************************************ 00:12:50.167 15:00:30 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:12:50.167 * Looking for test storage... 00:12:50.167 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:50.167 15:00:31 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:50.167 15:00:31 -- nvmf/common.sh@7 -- # uname -s 00:12:50.167 15:00:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:50.167 15:00:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:50.167 15:00:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:50.167 15:00:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:50.167 15:00:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:50.167 15:00:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:50.167 15:00:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:50.167 15:00:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:50.167 15:00:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:50.167 15:00:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:50.167 15:00:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:50.167 15:00:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:12:50.167 15:00:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:50.167 15:00:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:50.167 15:00:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:50.167 15:00:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:50.167 15:00:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:50.167 15:00:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:50.167 15:00:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:50.167 15:00:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:50.167 15:00:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.167 15:00:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.167 15:00:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.167 15:00:31 -- paths/export.sh@5 -- # export PATH 00:12:50.167 15:00:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:50.167 15:00:31 -- nvmf/common.sh@47 -- # : 0 00:12:50.167 15:00:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:50.167 15:00:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:50.167 15:00:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:50.168 15:00:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:50.168 15:00:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:50.168 15:00:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:50.168 15:00:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:50.168 15:00:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:50.168 15:00:31 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:50.168 15:00:31 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:50.168 15:00:31 -- target/nvme_cli.sh@14 -- # devs=() 00:12:50.168 15:00:31 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:12:50.168 15:00:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:50.168 15:00:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:50.168 15:00:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:50.168 15:00:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:50.168 15:00:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:50.168 15:00:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:50.168 15:00:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:50.168 15:00:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:50.429 15:00:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:50.429 15:00:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:50.429 15:00:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:50.429 15:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:57.021 15:00:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:57.021 15:00:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:57.021 15:00:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:57.021 15:00:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:57.021 15:00:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:57.021 15:00:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:57.021 15:00:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:57.021 15:00:37 -- nvmf/common.sh@295 -- # net_devs=() 00:12:57.021 15:00:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:57.021 15:00:37 -- nvmf/common.sh@296 -- # e810=() 00:12:57.021 15:00:37 -- nvmf/common.sh@296 -- # local -ga e810 00:12:57.021 15:00:37 -- nvmf/common.sh@297 -- # x722=() 00:12:57.021 15:00:37 -- nvmf/common.sh@297 -- # local -ga x722 00:12:57.021 15:00:37 -- nvmf/common.sh@298 -- # mlx=() 00:12:57.021 15:00:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:57.021 15:00:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:57.021 15:00:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:12:57.021 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:12:57.021 15:00:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:57.021 15:00:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:12:57.021 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:12:57.021 15:00:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:57.021 15:00:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.021 15:00:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.021 15:00:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:12:57.021 Found net devices under 0000:31:00.0: mlx_0_0 00:12:57.021 15:00:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.021 15:00:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.021 15:00:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:12:57.021 Found net devices under 0000:31:00.1: mlx_0_1 00:12:57.021 15:00:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.021 15:00:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:57.021 15:00:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:57.021 15:00:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:57.021 15:00:37 -- nvmf/common.sh@58 -- # uname 00:12:57.021 15:00:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:57.021 15:00:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:57.021 15:00:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:57.021 15:00:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:57.021 15:00:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:57.021 15:00:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:57.021 15:00:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:57.021 15:00:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:57.021 15:00:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:57.021 15:00:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:57.021 15:00:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:57.021 15:00:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:57.021 15:00:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:57.021 15:00:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:57.021 15:00:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:57.021 15:00:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:57.021 15:00:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:57.021 15:00:37 -- nvmf/common.sh@105 -- # continue 2 00:12:57.021 15:00:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.021 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:57.021 15:00:37 -- nvmf/common.sh@105 -- # continue 2 00:12:57.021 15:00:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:57.021 15:00:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:57.021 15:00:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.021 15:00:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:57.021 15:00:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:57.021 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:57.021 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:12:57.021 altname enp49s0f0np0 00:12:57.021 altname ens786f0np0 00:12:57.021 inet 192.168.100.8/24 scope global mlx_0_0 00:12:57.021 valid_lft forever preferred_lft forever 00:12:57.021 15:00:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:57.021 15:00:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:57.021 15:00:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.021 15:00:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.021 15:00:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:57.021 15:00:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:57.021 15:00:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:57.021 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:57.021 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:12:57.021 altname enp49s0f1np1 00:12:57.021 altname ens786f1np1 00:12:57.021 inet 192.168.100.9/24 scope global mlx_0_1 00:12:57.021 valid_lft forever preferred_lft forever 00:12:57.022 15:00:37 -- nvmf/common.sh@411 -- # return 0 00:12:57.022 15:00:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:57.022 15:00:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:57.022 15:00:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:57.022 15:00:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:57.022 15:00:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:57.022 15:00:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:57.022 15:00:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:57.022 15:00:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:57.022 15:00:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:57.022 15:00:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:57.022 15:00:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.022 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.022 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:57.022 15:00:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:57.022 15:00:37 -- nvmf/common.sh@105 -- # continue 2 00:12:57.022 15:00:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.022 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.022 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:57.022 15:00:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.022 15:00:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:57.022 15:00:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:57.022 15:00:37 -- nvmf/common.sh@105 -- # continue 2 00:12:57.022 15:00:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:57.022 15:00:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:57.022 15:00:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.022 15:00:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:57.022 15:00:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:57.022 15:00:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.022 15:00:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.022 15:00:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:57.022 192.168.100.9' 00:12:57.022 15:00:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:57.022 192.168.100.9' 00:12:57.022 15:00:37 -- nvmf/common.sh@446 -- # head -n 1 00:12:57.022 15:00:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:57.022 15:00:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:57.022 192.168.100.9' 00:12:57.022 15:00:37 -- nvmf/common.sh@447 -- # tail -n +2 00:12:57.022 15:00:37 -- nvmf/common.sh@447 -- # head -n 1 00:12:57.022 15:00:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:57.022 15:00:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:57.022 15:00:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:57.022 15:00:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:57.022 15:00:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:57.022 15:00:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:57.022 15:00:37 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:12:57.022 15:00:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:57.022 15:00:37 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:57.022 15:00:37 -- common/autotest_common.sh@10 -- # set +x 00:12:57.022 15:00:37 -- nvmf/common.sh@470 -- # nvmfpid=3447739 00:12:57.022 15:00:37 -- nvmf/common.sh@471 -- # waitforlisten 3447739 00:12:57.022 15:00:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:57.022 15:00:37 -- common/autotest_common.sh@827 -- # '[' -z 3447739 ']' 00:12:57.022 15:00:37 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:57.022 15:00:37 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:57.022 15:00:37 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:57.022 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:57.022 15:00:37 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:57.022 15:00:37 -- common/autotest_common.sh@10 -- # set +x 00:12:57.022 [2024-04-26 15:00:37.950426] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:12:57.022 [2024-04-26 15:00:37.950493] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:57.282 EAL: No free 2048 kB hugepages reported on node 1 00:12:57.282 [2024-04-26 15:00:38.017299] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:57.282 [2024-04-26 15:00:38.090811] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:57.282 [2024-04-26 15:00:38.090850] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:57.282 [2024-04-26 15:00:38.090860] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:57.282 [2024-04-26 15:00:38.090867] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:57.282 [2024-04-26 15:00:38.090874] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:57.282 [2024-04-26 15:00:38.091012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:57.282 [2024-04-26 15:00:38.091110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:57.282 [2024-04-26 15:00:38.091266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:57.282 [2024-04-26 15:00:38.091269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:57.853 15:00:38 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:57.853 15:00:38 -- common/autotest_common.sh@860 -- # return 0 00:12:57.853 15:00:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:57.853 15:00:38 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:57.853 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:57.853 15:00:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:57.853 15:00:38 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:57.853 15:00:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:57.853 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:58.112 [2024-04-26 15:00:38.814354] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x157fb00/0x1583ff0) succeed. 00:12:58.112 [2024-04-26 15:00:38.827645] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1581140/0x15c5680) succeed. 00:12:58.112 15:00:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.112 15:00:38 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:58.112 15:00:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.112 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:58.112 Malloc0 00:12:58.112 15:00:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.112 15:00:38 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:58.112 15:00:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 Malloc1 00:12:58.113 15:00:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:38 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:12:58.113 15:00:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 15:00:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:38 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:58.113 15:00:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:38 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 15:00:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:39 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:58.113 15:00:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 15:00:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:39 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:58.113 15:00:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 [2024-04-26 15:00:39.031180] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:58.113 15:00:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:39 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:58.113 15:00:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:58.113 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:58.113 15:00:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:58.113 15:00:39 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -a 192.168.100.8 -s 4420 00:12:58.373 00:12:58.373 Discovery Log Number of Records 2, Generation counter 2 00:12:58.373 =====Discovery Log Entry 0====== 00:12:58.373 trtype: rdma 00:12:58.373 adrfam: ipv4 00:12:58.373 subtype: current discovery subsystem 00:12:58.373 treq: not required 00:12:58.373 portid: 0 00:12:58.373 trsvcid: 4420 00:12:58.373 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:12:58.373 traddr: 192.168.100.8 00:12:58.373 eflags: explicit discovery connections, duplicate discovery information 00:12:58.373 rdma_prtype: not specified 00:12:58.373 rdma_qptype: connected 00:12:58.373 rdma_cms: rdma-cm 00:12:58.373 rdma_pkey: 0x0000 00:12:58.373 =====Discovery Log Entry 1====== 00:12:58.373 trtype: rdma 00:12:58.373 adrfam: ipv4 00:12:58.373 subtype: nvme subsystem 00:12:58.373 treq: not required 00:12:58.373 portid: 0 00:12:58.373 trsvcid: 4420 00:12:58.373 subnqn: nqn.2016-06.io.spdk:cnode1 00:12:58.373 traddr: 192.168.100.8 00:12:58.373 eflags: none 00:12:58.373 rdma_prtype: not specified 00:12:58.373 rdma_qptype: connected 00:12:58.373 rdma_cms: rdma-cm 00:12:58.373 rdma_pkey: 0x0000 00:12:58.373 15:00:39 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:12:58.373 15:00:39 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:12:58.373 15:00:39 -- nvmf/common.sh@511 -- # local dev _ 00:12:58.373 15:00:39 -- nvmf/common.sh@513 -- # read -r dev _ 00:12:58.373 15:00:39 -- nvmf/common.sh@510 -- # nvme list 00:12:58.373 15:00:39 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:12:58.373 15:00:39 -- nvmf/common.sh@513 -- # read -r dev _ 00:12:58.373 15:00:39 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:12:58.373 15:00:39 -- nvmf/common.sh@513 -- # read -r dev _ 00:12:58.373 15:00:39 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:12:58.373 15:00:39 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:13:04.962 15:00:44 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:04.962 15:00:44 -- common/autotest_common.sh@1194 -- # local i=0 00:13:04.962 15:00:44 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:13:04.962 15:00:44 -- common/autotest_common.sh@1196 -- # [[ -n 2 ]] 00:13:04.962 15:00:44 -- common/autotest_common.sh@1197 -- # nvme_device_counter=2 00:13:04.962 15:00:44 -- common/autotest_common.sh@1201 -- # sleep 2 00:13:06.346 15:00:46 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:13:06.346 15:00:46 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:13:06.346 15:00:46 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:13:06.346 15:00:46 -- common/autotest_common.sh@1203 -- # nvme_devices=2 00:13:06.346 15:00:46 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:13:06.346 15:00:46 -- common/autotest_common.sh@1204 -- # return 0 00:13:06.346 15:00:46 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:06.346 15:00:46 -- nvmf/common.sh@511 -- # local dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@510 -- # nvme list 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:13:06.346 /dev/nvme0n1 ]] 00:13:06.346 15:00:46 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:06.346 15:00:46 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:06.346 15:00:46 -- nvmf/common.sh@511 -- # local dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@510 -- # nvme list 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:06.346 15:00:46 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:13:06.346 15:00:46 -- nvmf/common.sh@513 -- # read -r dev _ 00:13:06.346 15:00:46 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:06.346 15:00:46 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:10.554 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:10.554 15:00:50 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:10.554 15:00:50 -- common/autotest_common.sh@1215 -- # local i=0 00:13:10.554 15:00:50 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:13:10.554 15:00:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:10.554 15:00:50 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:13:10.554 15:00:50 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:10.554 15:00:50 -- common/autotest_common.sh@1227 -- # return 0 00:13:10.554 15:00:50 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:10.554 15:00:50 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:10.554 15:00:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:10.554 15:00:50 -- common/autotest_common.sh@10 -- # set +x 00:13:10.554 15:00:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:10.554 15:00:50 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:10.554 15:00:50 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:10.554 15:00:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:10.554 15:00:50 -- nvmf/common.sh@117 -- # sync 00:13:10.554 15:00:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:10.554 15:00:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:10.554 15:00:50 -- nvmf/common.sh@120 -- # set +e 00:13:10.554 15:00:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:10.554 15:00:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:10.554 rmmod nvme_rdma 00:13:10.554 rmmod nvme_fabrics 00:13:10.554 15:00:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:10.554 15:00:50 -- nvmf/common.sh@124 -- # set -e 00:13:10.554 15:00:50 -- nvmf/common.sh@125 -- # return 0 00:13:10.554 15:00:50 -- nvmf/common.sh@478 -- # '[' -n 3447739 ']' 00:13:10.554 15:00:50 -- nvmf/common.sh@479 -- # killprocess 3447739 00:13:10.554 15:00:50 -- common/autotest_common.sh@946 -- # '[' -z 3447739 ']' 00:13:10.554 15:00:50 -- common/autotest_common.sh@950 -- # kill -0 3447739 00:13:10.554 15:00:50 -- common/autotest_common.sh@951 -- # uname 00:13:10.554 15:00:50 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:10.554 15:00:50 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3447739 00:13:10.554 15:00:50 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:13:10.554 15:00:50 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:13:10.555 15:00:50 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3447739' 00:13:10.555 killing process with pid 3447739 00:13:10.555 15:00:50 -- common/autotest_common.sh@965 -- # kill 3447739 00:13:10.555 15:00:50 -- common/autotest_common.sh@970 -- # wait 3447739 00:13:10.555 [2024-04-26 15:00:50.994487] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:10.555 15:00:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:10.555 15:00:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:10.555 00:13:10.555 real 0m20.166s 00:13:10.555 user 0m54.142s 00:13:10.555 sys 0m5.585s 00:13:10.555 15:00:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:10.555 15:00:51 -- common/autotest_common.sh@10 -- # set +x 00:13:10.555 ************************************ 00:13:10.555 END TEST nvmf_nvme_cli 00:13:10.555 ************************************ 00:13:10.555 15:00:51 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:13:10.555 15:00:51 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:13:10.555 15:00:51 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:10.555 15:00:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:10.555 15:00:51 -- common/autotest_common.sh@10 -- # set +x 00:13:10.555 ************************************ 00:13:10.555 START TEST nvmf_host_management 00:13:10.555 ************************************ 00:13:10.555 15:00:51 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:13:10.555 * Looking for test storage... 00:13:10.555 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:10.555 15:00:51 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:10.555 15:00:51 -- nvmf/common.sh@7 -- # uname -s 00:13:10.555 15:00:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:10.555 15:00:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:10.555 15:00:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:10.555 15:00:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:10.555 15:00:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:10.555 15:00:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:10.555 15:00:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:10.555 15:00:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:10.555 15:00:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:10.555 15:00:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:10.555 15:00:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:10.555 15:00:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:10.555 15:00:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:10.555 15:00:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:10.555 15:00:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:10.555 15:00:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:10.555 15:00:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:10.555 15:00:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:10.555 15:00:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:10.555 15:00:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:10.555 15:00:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.555 15:00:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.555 15:00:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.555 15:00:51 -- paths/export.sh@5 -- # export PATH 00:13:10.555 15:00:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.555 15:00:51 -- nvmf/common.sh@47 -- # : 0 00:13:10.555 15:00:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:10.555 15:00:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:10.555 15:00:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:10.555 15:00:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:10.555 15:00:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:10.555 15:00:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:10.555 15:00:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:10.555 15:00:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:10.555 15:00:51 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:10.555 15:00:51 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:10.555 15:00:51 -- target/host_management.sh@105 -- # nvmftestinit 00:13:10.555 15:00:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:10.555 15:00:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:10.555 15:00:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:10.555 15:00:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:10.555 15:00:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:10.555 15:00:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:10.555 15:00:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:10.555 15:00:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:10.555 15:00:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:10.555 15:00:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:10.555 15:00:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:10.555 15:00:51 -- common/autotest_common.sh@10 -- # set +x 00:13:17.153 15:00:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.153 15:00:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:17.153 15:00:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:17.153 15:00:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:17.153 15:00:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:17.153 15:00:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:17.153 15:00:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:17.153 15:00:57 -- nvmf/common.sh@295 -- # net_devs=() 00:13:17.153 15:00:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:17.153 15:00:57 -- nvmf/common.sh@296 -- # e810=() 00:13:17.153 15:00:57 -- nvmf/common.sh@296 -- # local -ga e810 00:13:17.153 15:00:57 -- nvmf/common.sh@297 -- # x722=() 00:13:17.153 15:00:57 -- nvmf/common.sh@297 -- # local -ga x722 00:13:17.153 15:00:57 -- nvmf/common.sh@298 -- # mlx=() 00:13:17.153 15:00:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:17.153 15:00:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.153 15:00:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:17.153 15:00:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:17.153 15:00:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:13:17.153 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:13:17.153 15:00:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:17.153 15:00:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:17.153 15:00:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:13:17.153 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:13:17.153 15:00:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:17.153 15:00:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:17.153 15:00:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:17.153 15:00:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.153 15:00:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:17.153 15:00:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.153 15:00:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:13:17.153 Found net devices under 0000:31:00.0: mlx_0_0 00:13:17.153 15:00:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:17.153 15:00:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.153 15:00:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:17.153 15:00:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.153 15:00:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:13:17.153 Found net devices under 0000:31:00.1: mlx_0_1 00:13:17.153 15:00:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.153 15:00:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:17.153 15:00:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:17.153 15:00:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:17.153 15:00:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:17.153 15:00:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:17.153 15:00:57 -- nvmf/common.sh@58 -- # uname 00:13:17.153 15:00:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:17.153 15:00:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:17.153 15:00:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:17.153 15:00:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:17.153 15:00:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:17.153 15:00:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:17.153 15:00:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:17.153 15:00:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:17.153 15:00:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:17.153 15:00:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:17.153 15:00:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:17.153 15:00:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:17.153 15:00:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:17.153 15:00:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:17.153 15:00:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:17.153 15:00:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:17.153 15:00:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:17.153 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.153 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:17.153 15:00:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:17.153 15:00:58 -- nvmf/common.sh@105 -- # continue 2 00:13:17.153 15:00:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:17.153 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.153 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:17.153 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.153 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:17.153 15:00:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:17.153 15:00:58 -- nvmf/common.sh@105 -- # continue 2 00:13:17.153 15:00:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:17.153 15:00:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:17.153 15:00:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:17.153 15:00:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:17.153 15:00:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:17.153 15:00:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:17.153 15:00:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:17.153 15:00:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:17.153 15:00:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:17.153 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:17.153 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:13:17.153 altname enp49s0f0np0 00:13:17.153 altname ens786f0np0 00:13:17.154 inet 192.168.100.8/24 scope global mlx_0_0 00:13:17.154 valid_lft forever preferred_lft forever 00:13:17.154 15:00:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:17.154 15:00:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:17.154 15:00:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:17.154 15:00:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:17.154 15:00:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:17.154 15:00:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:17.154 15:00:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:17.154 15:00:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:17.154 15:00:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:17.154 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:17.154 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:13:17.154 altname enp49s0f1np1 00:13:17.154 altname ens786f1np1 00:13:17.154 inet 192.168.100.9/24 scope global mlx_0_1 00:13:17.154 valid_lft forever preferred_lft forever 00:13:17.154 15:00:58 -- nvmf/common.sh@411 -- # return 0 00:13:17.154 15:00:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:17.154 15:00:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:17.154 15:00:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:17.154 15:00:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:17.154 15:00:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:17.154 15:00:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:17.154 15:00:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:17.154 15:00:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:17.154 15:00:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:17.154 15:00:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:17.154 15:00:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:17.154 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.154 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:17.154 15:00:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:17.154 15:00:58 -- nvmf/common.sh@105 -- # continue 2 00:13:17.416 15:00:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:17.416 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.416 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:17.416 15:00:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:17.416 15:00:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:17.416 15:00:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:17.416 15:00:58 -- nvmf/common.sh@105 -- # continue 2 00:13:17.416 15:00:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:17.416 15:00:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:17.416 15:00:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:17.416 15:00:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:17.416 15:00:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:17.416 15:00:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:17.416 15:00:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:17.416 15:00:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:17.416 192.168.100.9' 00:13:17.416 15:00:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:17.416 192.168.100.9' 00:13:17.416 15:00:58 -- nvmf/common.sh@446 -- # head -n 1 00:13:17.416 15:00:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:17.416 15:00:58 -- nvmf/common.sh@447 -- # head -n 1 00:13:17.416 15:00:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:17.416 192.168.100.9' 00:13:17.416 15:00:58 -- nvmf/common.sh@447 -- # tail -n +2 00:13:17.416 15:00:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:17.416 15:00:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:17.416 15:00:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:17.416 15:00:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:17.416 15:00:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:17.416 15:00:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:17.416 15:00:58 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:13:17.416 15:00:58 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:13:17.416 15:00:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:17.416 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:13:17.416 ************************************ 00:13:17.416 START TEST nvmf_host_management 00:13:17.416 ************************************ 00:13:17.416 15:00:58 -- common/autotest_common.sh@1121 -- # nvmf_host_management 00:13:17.416 15:00:58 -- target/host_management.sh@69 -- # starttarget 00:13:17.416 15:00:58 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:17.416 15:00:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:17.416 15:00:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:17.416 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:13:17.416 15:00:58 -- nvmf/common.sh@470 -- # nvmfpid=3453932 00:13:17.416 15:00:58 -- nvmf/common.sh@471 -- # waitforlisten 3453932 00:13:17.416 15:00:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:17.416 15:00:58 -- common/autotest_common.sh@827 -- # '[' -z 3453932 ']' 00:13:17.416 15:00:58 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.416 15:00:58 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:17.416 15:00:58 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.416 15:00:58 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:17.416 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:13:17.677 [2024-04-26 15:00:58.388400] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:17.677 [2024-04-26 15:00:58.388477] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.677 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.677 [2024-04-26 15:00:58.454900] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:17.677 [2024-04-26 15:00:58.530194] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:17.677 [2024-04-26 15:00:58.530235] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:17.677 [2024-04-26 15:00:58.530245] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:17.677 [2024-04-26 15:00:58.530252] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:17.677 [2024-04-26 15:00:58.530264] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:17.677 [2024-04-26 15:00:58.530447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:17.677 [2024-04-26 15:00:58.530586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:17.677 [2024-04-26 15:00:58.530743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:17.677 [2024-04-26 15:00:58.530744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:18.247 15:00:59 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:18.247 15:00:59 -- common/autotest_common.sh@860 -- # return 0 00:13:18.247 15:00:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:18.247 15:00:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:18.247 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.507 15:00:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.507 15:00:59 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:18.507 15:00:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:18.507 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.507 [2024-04-26 15:00:59.241622] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xa48e00/0xa4d2f0) succeed. 00:13:18.507 [2024-04-26 15:00:59.255776] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa4a440/0xa8e980) succeed. 00:13:18.507 15:00:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:18.507 15:00:59 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:18.507 15:00:59 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:18.507 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.507 15:00:59 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:18.507 15:00:59 -- target/host_management.sh@23 -- # cat 00:13:18.507 15:00:59 -- target/host_management.sh@30 -- # rpc_cmd 00:13:18.507 15:00:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:18.507 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.507 Malloc0 00:13:18.507 [2024-04-26 15:00:59.434839] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:18.507 15:00:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:18.507 15:00:59 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:18.507 15:00:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:18.507 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.775 15:00:59 -- target/host_management.sh@73 -- # perfpid=3454248 00:13:18.775 15:00:59 -- target/host_management.sh@74 -- # waitforlisten 3454248 /var/tmp/bdevperf.sock 00:13:18.775 15:00:59 -- common/autotest_common.sh@827 -- # '[' -z 3454248 ']' 00:13:18.775 15:00:59 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:18.775 15:00:59 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:18.775 15:00:59 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:18.775 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:18.775 15:00:59 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:18.775 15:00:59 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:18.775 15:00:59 -- common/autotest_common.sh@10 -- # set +x 00:13:18.775 15:00:59 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:18.775 15:00:59 -- nvmf/common.sh@521 -- # config=() 00:13:18.775 15:00:59 -- nvmf/common.sh@521 -- # local subsystem config 00:13:18.775 15:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:18.775 15:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:18.775 { 00:13:18.775 "params": { 00:13:18.775 "name": "Nvme$subsystem", 00:13:18.775 "trtype": "$TEST_TRANSPORT", 00:13:18.775 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:18.775 "adrfam": "ipv4", 00:13:18.775 "trsvcid": "$NVMF_PORT", 00:13:18.775 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:18.775 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:18.775 "hdgst": ${hdgst:-false}, 00:13:18.775 "ddgst": ${ddgst:-false} 00:13:18.775 }, 00:13:18.775 "method": "bdev_nvme_attach_controller" 00:13:18.775 } 00:13:18.775 EOF 00:13:18.775 )") 00:13:18.775 15:00:59 -- nvmf/common.sh@543 -- # cat 00:13:18.775 15:00:59 -- nvmf/common.sh@545 -- # jq . 00:13:18.775 15:00:59 -- nvmf/common.sh@546 -- # IFS=, 00:13:18.775 15:00:59 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:18.775 "params": { 00:13:18.775 "name": "Nvme0", 00:13:18.775 "trtype": "rdma", 00:13:18.775 "traddr": "192.168.100.8", 00:13:18.775 "adrfam": "ipv4", 00:13:18.775 "trsvcid": "4420", 00:13:18.775 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:18.775 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:18.775 "hdgst": false, 00:13:18.775 "ddgst": false 00:13:18.775 }, 00:13:18.775 "method": "bdev_nvme_attach_controller" 00:13:18.775 }' 00:13:18.775 [2024-04-26 15:00:59.531656] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:18.775 [2024-04-26 15:00:59.531707] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3454248 ] 00:13:18.775 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.775 [2024-04-26 15:00:59.590462] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:18.775 [2024-04-26 15:00:59.653124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:19.035 Running I/O for 10 seconds... 00:13:19.607 15:01:00 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:19.607 15:01:00 -- common/autotest_common.sh@860 -- # return 0 00:13:19.607 15:01:00 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:19.607 15:01:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:19.607 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:13:19.607 15:01:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:19.607 15:01:00 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:19.607 15:01:00 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:19.607 15:01:00 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:19.607 15:01:00 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:19.607 15:01:00 -- target/host_management.sh@52 -- # local ret=1 00:13:19.607 15:01:00 -- target/host_management.sh@53 -- # local i 00:13:19.607 15:01:00 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:19.607 15:01:00 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:19.607 15:01:00 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:19.607 15:01:00 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:19.607 15:01:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:19.607 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:13:19.607 15:01:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:19.607 15:01:00 -- target/host_management.sh@55 -- # read_io_count=1267 00:13:19.607 15:01:00 -- target/host_management.sh@58 -- # '[' 1267 -ge 100 ']' 00:13:19.607 15:01:00 -- target/host_management.sh@59 -- # ret=0 00:13:19.607 15:01:00 -- target/host_management.sh@60 -- # break 00:13:19.607 15:01:00 -- target/host_management.sh@64 -- # return 0 00:13:19.607 15:01:00 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:19.607 15:01:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:19.607 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:13:19.607 15:01:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:19.607 15:01:00 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:19.607 15:01:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:19.607 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:13:19.607 15:01:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:19.607 15:01:00 -- target/host_management.sh@87 -- # sleep 1 00:13:20.549 [2024-04-26 15:01:01.415727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:47104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e9fd00 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:47232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e8fc80 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:47360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e7fc00 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:47488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e6fb80 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:47616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e5fb00 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:47744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e4fa80 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:47872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e3fa00 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:48000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e2f980 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:48128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e1f900 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:48256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e0f880 len:0x10000 key:0x188500 00:13:20.549 [2024-04-26 15:01:01.415932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:48384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a4b040 len:0x10000 key:0x188000 00:13:20.549 [2024-04-26 15:01:01.415948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:48512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a3afc0 len:0x10000 key:0x188000 00:13:20.549 [2024-04-26 15:01:01.415965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:48640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a2af40 len:0x10000 key:0x188000 00:13:20.549 [2024-04-26 15:01:01.415981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.415991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:48768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a1aec0 len:0x10000 key:0x188000 00:13:20.549 [2024-04-26 15:01:01.416000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.549 [2024-04-26 15:01:01.416009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:48896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a0ae40 len:0x10000 key:0x188000 00:13:20.549 [2024-04-26 15:01:01.416016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:49024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ea980 len:0x10000 key:0x188400 00:13:20.550 [2024-04-26 15:01:01.416033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bc40000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bc61000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:41216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bc82000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bca3000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bcc4000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:41600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bce5000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:41728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd06000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd27000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd48000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd69000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:42240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bd8a000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdab000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:42496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bdcc000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:42624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bded000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be0e000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:42880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be2f000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:43008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000114cf000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:43136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000114ae000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001148d000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:43392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001146c000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:43520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001144b000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:43648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001142a000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:43776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011409000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000113e8000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:44032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000113c7000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:44160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000113a6000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:44288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011385000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:44416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011364000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011343000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011322000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:44800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011301000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:44928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000112e0000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:45056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000116df000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:45184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000116be000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:45312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001169d000 len:0x10000 key:0x188300 00:13:20.550 [2024-04-26 15:01:01.416623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.550 [2024-04-26 15:01:01.416633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:45440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001167c000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:45568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001165b000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:45696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001163a000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:45824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011619000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:45952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000115f8000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:46080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000115d7000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:46208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000115b6000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:46336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011595000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:46464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011574000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:46592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011553000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:46720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011532000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:46848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011511000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.416830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:46976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000114f0000 len:0x10000 key:0x188300 00:13:20.551 [2024-04-26 15:01:01.416838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:13:20.551 [2024-04-26 15:01:01.418870] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:13:20.551 [2024-04-26 15:01:01.420089] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:20.551 task offset: 47104 on job bdev=Nvme0n1 fails 00:13:20.551 00:13:20.551 Latency(us) 00:13:20.551 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:20.551 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:20.551 Job: Nvme0n1 ended in about 1.58 seconds with error 00:13:20.551 Verification LBA range: start 0x0 length 0x400 00:13:20.551 Nvme0n1 : 1.58 852.93 53.31 40.62 0.00 71006.04 2471.25 1013623.47 00:13:20.551 =================================================================================================================== 00:13:20.551 Total : 852.93 53.31 40.62 0.00 71006.04 2471.25 1013623.47 00:13:20.551 [2024-04-26 15:01:01.422082] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:20.551 15:01:01 -- target/host_management.sh@91 -- # kill -9 3454248 00:13:20.551 15:01:01 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:20.551 15:01:01 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:20.551 15:01:01 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:20.551 15:01:01 -- nvmf/common.sh@521 -- # config=() 00:13:20.551 15:01:01 -- nvmf/common.sh@521 -- # local subsystem config 00:13:20.551 15:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:20.551 15:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:20.551 { 00:13:20.551 "params": { 00:13:20.551 "name": "Nvme$subsystem", 00:13:20.551 "trtype": "$TEST_TRANSPORT", 00:13:20.551 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:20.551 "adrfam": "ipv4", 00:13:20.551 "trsvcid": "$NVMF_PORT", 00:13:20.551 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:20.551 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:20.551 "hdgst": ${hdgst:-false}, 00:13:20.551 "ddgst": ${ddgst:-false} 00:13:20.551 }, 00:13:20.551 "method": "bdev_nvme_attach_controller" 00:13:20.551 } 00:13:20.551 EOF 00:13:20.551 )") 00:13:20.551 15:01:01 -- nvmf/common.sh@543 -- # cat 00:13:20.551 15:01:01 -- nvmf/common.sh@545 -- # jq . 00:13:20.551 15:01:01 -- nvmf/common.sh@546 -- # IFS=, 00:13:20.551 15:01:01 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:20.551 "params": { 00:13:20.551 "name": "Nvme0", 00:13:20.551 "trtype": "rdma", 00:13:20.551 "traddr": "192.168.100.8", 00:13:20.551 "adrfam": "ipv4", 00:13:20.551 "trsvcid": "4420", 00:13:20.551 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:20.551 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:20.551 "hdgst": false, 00:13:20.551 "ddgst": false 00:13:20.551 }, 00:13:20.551 "method": "bdev_nvme_attach_controller" 00:13:20.551 }' 00:13:20.551 [2024-04-26 15:01:01.476526] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:20.551 [2024-04-26 15:01:01.476580] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3454602 ] 00:13:20.812 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.812 [2024-04-26 15:01:01.535253] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:20.812 [2024-04-26 15:01:01.597806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:21.072 Running I/O for 1 seconds... 00:13:22.014 00:13:22.014 Latency(us) 00:13:22.014 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:22.014 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:22.014 Verification LBA range: start 0x0 length 0x400 00:13:22.014 Nvme0n1 : 1.01 2506.60 156.66 0.00 0.00 24959.34 1037.65 36263.25 00:13:22.014 =================================================================================================================== 00:13:22.014 Total : 2506.60 156.66 0.00 0.00 24959.34 1037.65 36263.25 00:13:22.014 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 3454248 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:13:22.014 15:01:02 -- target/host_management.sh@102 -- # stoptarget 00:13:22.014 15:01:02 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:22.014 15:01:02 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:22.014 15:01:02 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:22.275 15:01:02 -- target/host_management.sh@40 -- # nvmftestfini 00:13:22.275 15:01:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:22.275 15:01:02 -- nvmf/common.sh@117 -- # sync 00:13:22.275 15:01:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:22.275 15:01:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:22.275 15:01:02 -- nvmf/common.sh@120 -- # set +e 00:13:22.275 15:01:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:22.275 15:01:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:22.275 rmmod nvme_rdma 00:13:22.275 rmmod nvme_fabrics 00:13:22.275 15:01:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:22.275 15:01:03 -- nvmf/common.sh@124 -- # set -e 00:13:22.275 15:01:03 -- nvmf/common.sh@125 -- # return 0 00:13:22.275 15:01:03 -- nvmf/common.sh@478 -- # '[' -n 3453932 ']' 00:13:22.275 15:01:03 -- nvmf/common.sh@479 -- # killprocess 3453932 00:13:22.275 15:01:03 -- common/autotest_common.sh@946 -- # '[' -z 3453932 ']' 00:13:22.275 15:01:03 -- common/autotest_common.sh@950 -- # kill -0 3453932 00:13:22.275 15:01:03 -- common/autotest_common.sh@951 -- # uname 00:13:22.275 15:01:03 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:22.275 15:01:03 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3453932 00:13:22.275 15:01:03 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:13:22.275 15:01:03 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:13:22.275 15:01:03 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3453932' 00:13:22.275 killing process with pid 3453932 00:13:22.275 15:01:03 -- common/autotest_common.sh@965 -- # kill 3453932 00:13:22.275 15:01:03 -- common/autotest_common.sh@970 -- # wait 3453932 00:13:22.275 [2024-04-26 15:01:03.174339] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:22.536 [2024-04-26 15:01:03.292547] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:22.536 15:01:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:22.536 15:01:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:22.536 00:13:22.536 real 0m4.992s 00:13:22.536 user 0m22.455s 00:13:22.536 sys 0m0.814s 00:13:22.536 15:01:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:22.536 15:01:03 -- common/autotest_common.sh@10 -- # set +x 00:13:22.536 ************************************ 00:13:22.536 END TEST nvmf_host_management 00:13:22.536 ************************************ 00:13:22.536 15:01:03 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:13:22.536 00:13:22.536 real 0m12.015s 00:13:22.536 user 0m24.569s 00:13:22.536 sys 0m5.815s 00:13:22.536 15:01:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:22.536 15:01:03 -- common/autotest_common.sh@10 -- # set +x 00:13:22.536 ************************************ 00:13:22.536 END TEST nvmf_host_management 00:13:22.536 ************************************ 00:13:22.536 15:01:03 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:13:22.536 15:01:03 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:22.536 15:01:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:22.536 15:01:03 -- common/autotest_common.sh@10 -- # set +x 00:13:22.797 ************************************ 00:13:22.797 START TEST nvmf_lvol 00:13:22.797 ************************************ 00:13:22.797 15:01:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:13:22.797 * Looking for test storage... 00:13:22.797 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:22.797 15:01:03 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:22.797 15:01:03 -- nvmf/common.sh@7 -- # uname -s 00:13:22.797 15:01:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:22.797 15:01:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:22.797 15:01:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:22.797 15:01:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:22.797 15:01:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:22.797 15:01:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:22.797 15:01:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:22.797 15:01:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:22.797 15:01:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:22.797 15:01:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:22.797 15:01:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:22.797 15:01:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:22.797 15:01:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:22.797 15:01:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:22.797 15:01:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:22.797 15:01:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:22.797 15:01:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:22.797 15:01:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:22.798 15:01:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:22.798 15:01:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:22.798 15:01:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:22.798 15:01:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:22.798 15:01:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:22.798 15:01:03 -- paths/export.sh@5 -- # export PATH 00:13:22.798 15:01:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:22.798 15:01:03 -- nvmf/common.sh@47 -- # : 0 00:13:22.798 15:01:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:22.798 15:01:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:22.798 15:01:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:22.798 15:01:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:22.798 15:01:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:22.798 15:01:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:22.798 15:01:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:22.798 15:01:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:22.798 15:01:03 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:22.798 15:01:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:22.798 15:01:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:22.798 15:01:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:22.798 15:01:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:22.798 15:01:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:22.798 15:01:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:22.798 15:01:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:22.798 15:01:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:22.798 15:01:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:22.798 15:01:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:22.798 15:01:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:22.798 15:01:03 -- common/autotest_common.sh@10 -- # set +x 00:13:29.387 15:01:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:29.387 15:01:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:29.388 15:01:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:29.388 15:01:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:29.388 15:01:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:29.388 15:01:10 -- nvmf/common.sh@295 -- # net_devs=() 00:13:29.388 15:01:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@296 -- # e810=() 00:13:29.388 15:01:10 -- nvmf/common.sh@296 -- # local -ga e810 00:13:29.388 15:01:10 -- nvmf/common.sh@297 -- # x722=() 00:13:29.388 15:01:10 -- nvmf/common.sh@297 -- # local -ga x722 00:13:29.388 15:01:10 -- nvmf/common.sh@298 -- # mlx=() 00:13:29.388 15:01:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:29.388 15:01:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:29.388 15:01:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:13:29.388 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:13:29.388 15:01:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:29.388 15:01:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:13:29.388 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:13:29.388 15:01:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:29.388 15:01:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.388 15:01:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.388 15:01:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:13:29.388 Found net devices under 0000:31:00.0: mlx_0_0 00:13:29.388 15:01:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.388 15:01:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.388 15:01:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:13:29.388 Found net devices under 0000:31:00.1: mlx_0_1 00:13:29.388 15:01:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.388 15:01:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:29.388 15:01:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:29.388 15:01:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:29.388 15:01:10 -- nvmf/common.sh@58 -- # uname 00:13:29.388 15:01:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:29.388 15:01:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:29.388 15:01:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:29.388 15:01:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:29.388 15:01:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:29.388 15:01:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:29.388 15:01:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:29.388 15:01:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:29.388 15:01:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:29.388 15:01:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:29.388 15:01:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:29.388 15:01:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:29.388 15:01:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:29.388 15:01:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:29.388 15:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:29.388 15:01:10 -- nvmf/common.sh@105 -- # continue 2 00:13:29.388 15:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.388 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:29.388 15:01:10 -- nvmf/common.sh@105 -- # continue 2 00:13:29.388 15:01:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:29.388 15:01:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:29.388 15:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.388 15:01:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:29.388 15:01:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:29.388 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:29.388 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:13:29.388 altname enp49s0f0np0 00:13:29.388 altname ens786f0np0 00:13:29.388 inet 192.168.100.8/24 scope global mlx_0_0 00:13:29.388 valid_lft forever preferred_lft forever 00:13:29.388 15:01:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:29.388 15:01:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:29.388 15:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.388 15:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.388 15:01:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:29.388 15:01:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:29.388 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:29.388 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:13:29.388 altname enp49s0f1np1 00:13:29.388 altname ens786f1np1 00:13:29.388 inet 192.168.100.9/24 scope global mlx_0_1 00:13:29.388 valid_lft forever preferred_lft forever 00:13:29.388 15:01:10 -- nvmf/common.sh@411 -- # return 0 00:13:29.388 15:01:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:29.388 15:01:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:29.388 15:01:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:29.388 15:01:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:29.388 15:01:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:29.388 15:01:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:29.388 15:01:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:29.388 15:01:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:29.649 15:01:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:29.649 15:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.649 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.649 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:29.649 15:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:29.649 15:01:10 -- nvmf/common.sh@105 -- # continue 2 00:13:29.649 15:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.649 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.649 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:29.649 15:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.649 15:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:29.649 15:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:29.649 15:01:10 -- nvmf/common.sh@105 -- # continue 2 00:13:29.649 15:01:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:29.649 15:01:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:29.649 15:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.649 15:01:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:29.649 15:01:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:29.649 15:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.649 15:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.649 15:01:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:29.649 192.168.100.9' 00:13:29.649 15:01:10 -- nvmf/common.sh@446 -- # head -n 1 00:13:29.649 15:01:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:29.649 192.168.100.9' 00:13:29.649 15:01:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:29.649 15:01:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:29.649 192.168.100.9' 00:13:29.649 15:01:10 -- nvmf/common.sh@447 -- # tail -n +2 00:13:29.649 15:01:10 -- nvmf/common.sh@447 -- # head -n 1 00:13:29.649 15:01:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:29.649 15:01:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:29.649 15:01:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:29.649 15:01:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:29.649 15:01:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:29.649 15:01:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:29.649 15:01:10 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:29.649 15:01:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:29.649 15:01:10 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:29.649 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:13:29.649 15:01:10 -- nvmf/common.sh@470 -- # nvmfpid=3458621 00:13:29.649 15:01:10 -- nvmf/common.sh@471 -- # waitforlisten 3458621 00:13:29.649 15:01:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:29.649 15:01:10 -- common/autotest_common.sh@827 -- # '[' -z 3458621 ']' 00:13:29.649 15:01:10 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:29.649 15:01:10 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:29.650 15:01:10 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:29.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:29.650 15:01:10 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:29.650 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:13:29.650 [2024-04-26 15:01:10.475146] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:29.650 [2024-04-26 15:01:10.475194] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:29.650 EAL: No free 2048 kB hugepages reported on node 1 00:13:29.650 [2024-04-26 15:01:10.535267] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:29.932 [2024-04-26 15:01:10.598780] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:29.932 [2024-04-26 15:01:10.598820] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:29.932 [2024-04-26 15:01:10.598827] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:29.932 [2024-04-26 15:01:10.598833] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:29.932 [2024-04-26 15:01:10.598839] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:29.932 [2024-04-26 15:01:10.598946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:29.932 [2024-04-26 15:01:10.599082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:29.932 [2024-04-26 15:01:10.599085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:30.598 15:01:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:30.598 15:01:11 -- common/autotest_common.sh@860 -- # return 0 00:13:30.598 15:01:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:30.598 15:01:11 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:30.598 15:01:11 -- common/autotest_common.sh@10 -- # set +x 00:13:30.598 15:01:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:30.598 15:01:11 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:30.598 [2024-04-26 15:01:11.443797] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x82d090/0x831580) succeed. 00:13:30.598 [2024-04-26 15:01:11.456538] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x82e630/0x872c10) succeed. 00:13:30.857 15:01:11 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:30.857 15:01:11 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:30.857 15:01:11 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:31.116 15:01:11 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:31.116 15:01:11 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:31.376 15:01:12 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:31.376 15:01:12 -- target/nvmf_lvol.sh@29 -- # lvs=1ae5c7fe-bc56-4a63-8a17-92fa9bd0fcbe 00:13:31.376 15:01:12 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1ae5c7fe-bc56-4a63-8a17-92fa9bd0fcbe lvol 20 00:13:31.642 15:01:12 -- target/nvmf_lvol.sh@32 -- # lvol=f7071dbe-3bbf-465c-bd38-476a8419175e 00:13:31.642 15:01:12 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:31.642 15:01:12 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 f7071dbe-3bbf-465c-bd38-476a8419175e 00:13:31.904 15:01:12 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:13:32.165 [2024-04-26 15:01:12.880105] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:32.165 15:01:12 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:13:32.165 15:01:13 -- target/nvmf_lvol.sh@42 -- # perf_pid=3459314 00:13:32.165 15:01:13 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:32.165 15:01:13 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:32.165 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.550 15:01:14 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot f7071dbe-3bbf-465c-bd38-476a8419175e MY_SNAPSHOT 00:13:33.550 15:01:14 -- target/nvmf_lvol.sh@47 -- # snapshot=d3fe45c6-ea79-4770-8e22-28d8ea273e90 00:13:33.550 15:01:14 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize f7071dbe-3bbf-465c-bd38-476a8419175e 30 00:13:33.550 15:01:14 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone d3fe45c6-ea79-4770-8e22-28d8ea273e90 MY_CLONE 00:13:33.810 15:01:14 -- target/nvmf_lvol.sh@49 -- # clone=1a0b141d-4656-4515-bf1d-22db7d3d5c48 00:13:33.810 15:01:14 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 1a0b141d-4656-4515-bf1d-22db7d3d5c48 00:13:34.069 15:01:14 -- target/nvmf_lvol.sh@53 -- # wait 3459314 00:13:44.067 Initializing NVMe Controllers 00:13:44.067 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:13:44.067 Controller IO queue size 128, less than required. 00:13:44.067 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:44.067 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:13:44.067 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:13:44.067 Initialization complete. Launching workers. 00:13:44.067 ======================================================== 00:13:44.067 Latency(us) 00:13:44.067 Device Information : IOPS MiB/s Average min max 00:13:44.067 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 17058.40 66.63 7505.56 2138.78 38389.05 00:13:44.067 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 24562.30 95.95 5211.73 2523.22 33345.94 00:13:44.067 ======================================================== 00:13:44.067 Total : 41620.70 162.58 6151.86 2138.78 38389.05 00:13:44.067 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f7071dbe-3bbf-465c-bd38-476a8419175e 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1ae5c7fe-bc56-4a63-8a17-92fa9bd0fcbe 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@60 -- # rm -f 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:13:44.067 15:01:24 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:13:44.067 15:01:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:44.067 15:01:24 -- nvmf/common.sh@117 -- # sync 00:13:44.067 15:01:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:44.067 15:01:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:44.067 15:01:24 -- nvmf/common.sh@120 -- # set +e 00:13:44.067 15:01:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:44.067 15:01:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:44.067 rmmod nvme_rdma 00:13:44.067 rmmod nvme_fabrics 00:13:44.067 15:01:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:44.067 15:01:24 -- nvmf/common.sh@124 -- # set -e 00:13:44.067 15:01:24 -- nvmf/common.sh@125 -- # return 0 00:13:44.067 15:01:24 -- nvmf/common.sh@478 -- # '[' -n 3458621 ']' 00:13:44.067 15:01:24 -- nvmf/common.sh@479 -- # killprocess 3458621 00:13:44.067 15:01:24 -- common/autotest_common.sh@946 -- # '[' -z 3458621 ']' 00:13:44.067 15:01:24 -- common/autotest_common.sh@950 -- # kill -0 3458621 00:13:44.067 15:01:24 -- common/autotest_common.sh@951 -- # uname 00:13:44.067 15:01:24 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:44.067 15:01:24 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3458621 00:13:44.327 15:01:25 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:13:44.327 15:01:25 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:13:44.327 15:01:25 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3458621' 00:13:44.327 killing process with pid 3458621 00:13:44.327 15:01:25 -- common/autotest_common.sh@965 -- # kill 3458621 00:13:44.327 15:01:25 -- common/autotest_common.sh@970 -- # wait 3458621 00:13:44.327 [2024-04-26 15:01:25.089214] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:44.327 15:01:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:44.327 15:01:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:44.327 00:13:44.327 real 0m21.690s 00:13:44.327 user 1m10.287s 00:13:44.327 sys 0m5.803s 00:13:44.327 15:01:25 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:44.327 15:01:25 -- common/autotest_common.sh@10 -- # set +x 00:13:44.327 ************************************ 00:13:44.327 END TEST nvmf_lvol 00:13:44.327 ************************************ 00:13:44.589 15:01:25 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:13:44.589 15:01:25 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:44.589 15:01:25 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:44.589 15:01:25 -- common/autotest_common.sh@10 -- # set +x 00:13:44.589 ************************************ 00:13:44.589 START TEST nvmf_lvs_grow 00:13:44.589 ************************************ 00:13:44.589 15:01:25 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:13:44.589 * Looking for test storage... 00:13:44.589 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:44.589 15:01:25 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:44.589 15:01:25 -- nvmf/common.sh@7 -- # uname -s 00:13:44.589 15:01:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:44.589 15:01:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:44.589 15:01:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:44.589 15:01:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:44.589 15:01:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:44.589 15:01:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:44.589 15:01:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:44.589 15:01:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:44.589 15:01:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:44.589 15:01:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:44.589 15:01:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:44.589 15:01:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:13:44.589 15:01:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:44.589 15:01:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:44.589 15:01:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:44.589 15:01:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:44.589 15:01:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:44.851 15:01:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:44.851 15:01:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:44.851 15:01:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:44.851 15:01:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.851 15:01:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.851 15:01:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.851 15:01:25 -- paths/export.sh@5 -- # export PATH 00:13:44.851 15:01:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:44.851 15:01:25 -- nvmf/common.sh@47 -- # : 0 00:13:44.851 15:01:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:44.851 15:01:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:44.851 15:01:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:44.851 15:01:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:44.851 15:01:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:44.851 15:01:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:44.851 15:01:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:44.851 15:01:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:44.851 15:01:25 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:44.851 15:01:25 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:44.851 15:01:25 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:13:44.851 15:01:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:44.851 15:01:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:44.851 15:01:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:44.851 15:01:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:44.851 15:01:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:44.851 15:01:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.851 15:01:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.851 15:01:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:44.851 15:01:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:44.851 15:01:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:44.851 15:01:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:44.851 15:01:25 -- common/autotest_common.sh@10 -- # set +x 00:13:51.451 15:01:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:51.451 15:01:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:51.451 15:01:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:51.451 15:01:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:51.451 15:01:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:51.451 15:01:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:51.451 15:01:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:51.451 15:01:32 -- nvmf/common.sh@295 -- # net_devs=() 00:13:51.451 15:01:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:51.452 15:01:32 -- nvmf/common.sh@296 -- # e810=() 00:13:51.452 15:01:32 -- nvmf/common.sh@296 -- # local -ga e810 00:13:51.452 15:01:32 -- nvmf/common.sh@297 -- # x722=() 00:13:51.452 15:01:32 -- nvmf/common.sh@297 -- # local -ga x722 00:13:51.452 15:01:32 -- nvmf/common.sh@298 -- # mlx=() 00:13:51.452 15:01:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:51.452 15:01:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:51.452 15:01:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:13:51.452 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:13:51.452 15:01:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:51.452 15:01:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:13:51.452 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:13:51.452 15:01:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:51.452 15:01:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.452 15:01:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.452 15:01:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:13:51.452 Found net devices under 0000:31:00.0: mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:51.452 15:01:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:51.452 15:01:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:13:51.452 Found net devices under 0000:31:00.1: mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:51.452 15:01:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:51.452 15:01:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:51.452 15:01:32 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:51.452 15:01:32 -- nvmf/common.sh@58 -- # uname 00:13:51.452 15:01:32 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:51.452 15:01:32 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:51.452 15:01:32 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:51.452 15:01:32 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:51.452 15:01:32 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:51.452 15:01:32 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:51.452 15:01:32 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:51.452 15:01:32 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:51.452 15:01:32 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:51.452 15:01:32 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:51.452 15:01:32 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:51.452 15:01:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:51.452 15:01:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:51.452 15:01:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:51.452 15:01:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:51.452 15:01:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@105 -- # continue 2 00:13:51.452 15:01:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@105 -- # continue 2 00:13:51.452 15:01:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:51.452 15:01:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:51.452 15:01:32 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:51.452 15:01:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:51.452 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:51.452 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:13:51.452 altname enp49s0f0np0 00:13:51.452 altname ens786f0np0 00:13:51.452 inet 192.168.100.8/24 scope global mlx_0_0 00:13:51.452 valid_lft forever preferred_lft forever 00:13:51.452 15:01:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:51.452 15:01:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:51.452 15:01:32 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:51.452 15:01:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:51.452 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:51.452 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:13:51.452 altname enp49s0f1np1 00:13:51.452 altname ens786f1np1 00:13:51.452 inet 192.168.100.9/24 scope global mlx_0_1 00:13:51.452 valid_lft forever preferred_lft forever 00:13:51.452 15:01:32 -- nvmf/common.sh@411 -- # return 0 00:13:51.452 15:01:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:51.452 15:01:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:51.452 15:01:32 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:51.452 15:01:32 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:51.452 15:01:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:51.452 15:01:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:51.452 15:01:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:51.452 15:01:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:51.452 15:01:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:51.452 15:01:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@105 -- # continue 2 00:13:51.452 15:01:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:51.452 15:01:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:51.452 15:01:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@105 -- # continue 2 00:13:51.452 15:01:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:51.452 15:01:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:51.452 15:01:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:51.452 15:01:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:51.452 15:01:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:51.452 15:01:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:51.452 192.168.100.9' 00:13:51.452 15:01:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:51.452 192.168.100.9' 00:13:51.452 15:01:32 -- nvmf/common.sh@446 -- # head -n 1 00:13:51.452 15:01:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:51.452 15:01:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:51.452 192.168.100.9' 00:13:51.452 15:01:32 -- nvmf/common.sh@447 -- # tail -n +2 00:13:51.452 15:01:32 -- nvmf/common.sh@447 -- # head -n 1 00:13:51.452 15:01:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:51.452 15:01:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:51.452 15:01:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:51.452 15:01:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:51.452 15:01:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:51.452 15:01:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:51.452 15:01:32 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:13:51.452 15:01:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:51.452 15:01:32 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:51.452 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:13:51.452 15:01:32 -- nvmf/common.sh@470 -- # nvmfpid=3465323 00:13:51.452 15:01:32 -- nvmf/common.sh@471 -- # waitforlisten 3465323 00:13:51.452 15:01:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:13:51.452 15:01:32 -- common/autotest_common.sh@827 -- # '[' -z 3465323 ']' 00:13:51.452 15:01:32 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:51.452 15:01:32 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:51.452 15:01:32 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:51.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:51.452 15:01:32 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:51.452 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:13:51.452 [2024-04-26 15:01:32.340266] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:51.452 [2024-04-26 15:01:32.340322] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:51.452 EAL: No free 2048 kB hugepages reported on node 1 00:13:51.713 [2024-04-26 15:01:32.399572] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:51.713 [2024-04-26 15:01:32.462019] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:51.713 [2024-04-26 15:01:32.462057] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:51.713 [2024-04-26 15:01:32.462065] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:51.713 [2024-04-26 15:01:32.462071] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:51.713 [2024-04-26 15:01:32.462077] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:51.713 [2024-04-26 15:01:32.462102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:52.284 15:01:33 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:52.284 15:01:33 -- common/autotest_common.sh@860 -- # return 0 00:13:52.284 15:01:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:52.284 15:01:33 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:52.284 15:01:33 -- common/autotest_common.sh@10 -- # set +x 00:13:52.284 15:01:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:52.284 15:01:33 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:52.545 [2024-04-26 15:01:33.301800] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2493a50/0x2497f40) succeed. 00:13:52.545 [2024-04-26 15:01:33.313855] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2494f50/0x24d95d0) succeed. 00:13:52.545 15:01:33 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:13:52.545 15:01:33 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:13:52.545 15:01:33 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:52.545 15:01:33 -- common/autotest_common.sh@10 -- # set +x 00:13:52.805 ************************************ 00:13:52.805 START TEST lvs_grow_clean 00:13:52.805 ************************************ 00:13:52.805 15:01:33 -- common/autotest_common.sh@1121 -- # lvs_grow 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:13:52.805 15:01:33 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:13:53.065 15:01:33 -- target/nvmf_lvs_grow.sh@28 -- # lvs=687b7c73-560a-468c-a236-534fcdb36789 00:13:53.065 15:01:33 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:13:53.065 15:01:33 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 687b7c73-560a-468c-a236-534fcdb36789 lvol 150 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a434dfe9-7473-42e7-8412-5aab56d6f74a 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:53.325 15:01:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:13:53.585 [2024-04-26 15:01:34.347438] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:13:53.585 [2024-04-26 15:01:34.347488] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:13:53.585 true 00:13:53.585 15:01:34 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:13:53.585 15:01:34 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:13:53.585 15:01:34 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:13:53.585 15:01:34 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:53.846 15:01:34 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a434dfe9-7473-42e7-8412-5aab56d6f74a 00:13:54.106 15:01:34 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:13:54.106 [2024-04-26 15:01:34.957584] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:54.106 15:01:34 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:13:54.367 15:01:35 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3465879 00:13:54.367 15:01:35 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:54.367 15:01:35 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3465879 /var/tmp/bdevperf.sock 00:13:54.367 15:01:35 -- common/autotest_common.sh@827 -- # '[' -z 3465879 ']' 00:13:54.367 15:01:35 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:54.367 15:01:35 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:54.367 15:01:35 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:54.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:54.367 15:01:35 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:54.367 15:01:35 -- common/autotest_common.sh@10 -- # set +x 00:13:54.367 15:01:35 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:13:54.367 [2024-04-26 15:01:35.168193] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:13:54.367 [2024-04-26 15:01:35.168244] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3465879 ] 00:13:54.367 EAL: No free 2048 kB hugepages reported on node 1 00:13:54.367 [2024-04-26 15:01:35.226308] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:54.367 [2024-04-26 15:01:35.288417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.311 15:01:35 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:55.311 15:01:35 -- common/autotest_common.sh@860 -- # return 0 00:13:55.311 15:01:35 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:13:55.311 Nvme0n1 00:13:55.311 15:01:36 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:13:55.572 [ 00:13:55.572 { 00:13:55.572 "name": "Nvme0n1", 00:13:55.572 "aliases": [ 00:13:55.572 "a434dfe9-7473-42e7-8412-5aab56d6f74a" 00:13:55.572 ], 00:13:55.572 "product_name": "NVMe disk", 00:13:55.572 "block_size": 4096, 00:13:55.572 "num_blocks": 38912, 00:13:55.572 "uuid": "a434dfe9-7473-42e7-8412-5aab56d6f74a", 00:13:55.572 "assigned_rate_limits": { 00:13:55.572 "rw_ios_per_sec": 0, 00:13:55.572 "rw_mbytes_per_sec": 0, 00:13:55.572 "r_mbytes_per_sec": 0, 00:13:55.572 "w_mbytes_per_sec": 0 00:13:55.572 }, 00:13:55.572 "claimed": false, 00:13:55.572 "zoned": false, 00:13:55.572 "supported_io_types": { 00:13:55.572 "read": true, 00:13:55.572 "write": true, 00:13:55.572 "unmap": true, 00:13:55.572 "write_zeroes": true, 00:13:55.572 "flush": true, 00:13:55.572 "reset": true, 00:13:55.572 "compare": true, 00:13:55.572 "compare_and_write": true, 00:13:55.572 "abort": true, 00:13:55.572 "nvme_admin": true, 00:13:55.572 "nvme_io": true 00:13:55.572 }, 00:13:55.572 "memory_domains": [ 00:13:55.572 { 00:13:55.572 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:13:55.572 "dma_device_type": 0 00:13:55.572 } 00:13:55.572 ], 00:13:55.572 "driver_specific": { 00:13:55.572 "nvme": [ 00:13:55.572 { 00:13:55.572 "trid": { 00:13:55.572 "trtype": "RDMA", 00:13:55.572 "adrfam": "IPv4", 00:13:55.572 "traddr": "192.168.100.8", 00:13:55.572 "trsvcid": "4420", 00:13:55.572 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:13:55.572 }, 00:13:55.572 "ctrlr_data": { 00:13:55.572 "cntlid": 1, 00:13:55.572 "vendor_id": "0x8086", 00:13:55.572 "model_number": "SPDK bdev Controller", 00:13:55.572 "serial_number": "SPDK0", 00:13:55.572 "firmware_revision": "24.05", 00:13:55.572 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:55.572 "oacs": { 00:13:55.572 "security": 0, 00:13:55.572 "format": 0, 00:13:55.572 "firmware": 0, 00:13:55.572 "ns_manage": 0 00:13:55.572 }, 00:13:55.572 "multi_ctrlr": true, 00:13:55.572 "ana_reporting": false 00:13:55.572 }, 00:13:55.572 "vs": { 00:13:55.572 "nvme_version": "1.3" 00:13:55.572 }, 00:13:55.572 "ns_data": { 00:13:55.572 "id": 1, 00:13:55.572 "can_share": true 00:13:55.572 } 00:13:55.572 } 00:13:55.572 ], 00:13:55.572 "mp_policy": "active_passive" 00:13:55.572 } 00:13:55.572 } 00:13:55.572 ] 00:13:55.572 15:01:36 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3466057 00:13:55.572 15:01:36 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:13:55.572 15:01:36 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:13:55.572 Running I/O for 10 seconds... 00:13:56.516 Latency(us) 00:13:56.516 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:56.516 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:56.516 Nvme0n1 : 1.00 26655.00 104.12 0.00 0.00 0.00 0.00 0.00 00:13:56.516 =================================================================================================================== 00:13:56.516 Total : 26655.00 104.12 0.00 0.00 0.00 0.00 0.00 00:13:56.516 00:13:57.458 15:01:38 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 687b7c73-560a-468c-a236-534fcdb36789 00:13:57.458 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:57.458 Nvme0n1 : 2.00 26879.50 105.00 0.00 0.00 0.00 0.00 0.00 00:13:57.458 =================================================================================================================== 00:13:57.458 Total : 26879.50 105.00 0.00 0.00 0.00 0.00 0.00 00:13:57.458 00:13:57.718 true 00:13:57.718 15:01:38 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:13:57.718 15:01:38 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:13:57.718 15:01:38 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:13:57.718 15:01:38 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:13:57.718 15:01:38 -- target/nvmf_lvs_grow.sh@65 -- # wait 3466057 00:13:58.660 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:58.660 Nvme0n1 : 3.00 26953.67 105.29 0.00 0.00 0.00 0.00 0.00 00:13:58.660 =================================================================================================================== 00:13:58.660 Total : 26953.67 105.29 0.00 0.00 0.00 0.00 0.00 00:13:58.660 00:13:59.601 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:59.601 Nvme0n1 : 4.00 27015.00 105.53 0.00 0.00 0.00 0.00 0.00 00:13:59.601 =================================================================================================================== 00:13:59.601 Total : 27015.00 105.53 0.00 0.00 0.00 0.00 0.00 00:13:59.601 00:14:00.541 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:00.541 Nvme0n1 : 5.00 27065.00 105.72 0.00 0.00 0.00 0.00 0.00 00:14:00.541 =================================================================================================================== 00:14:00.541 Total : 27065.00 105.72 0.00 0.00 0.00 0.00 0.00 00:14:00.541 00:14:01.484 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:01.484 Nvme0n1 : 6.00 27097.67 105.85 0.00 0.00 0.00 0.00 0.00 00:14:01.484 =================================================================================================================== 00:14:01.484 Total : 27097.67 105.85 0.00 0.00 0.00 0.00 0.00 00:14:01.484 00:14:02.868 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:02.868 Nvme0n1 : 7.00 27127.71 105.97 0.00 0.00 0.00 0.00 0.00 00:14:02.868 =================================================================================================================== 00:14:02.868 Total : 27127.71 105.97 0.00 0.00 0.00 0.00 0.00 00:14:02.868 00:14:03.811 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:03.811 Nvme0n1 : 8.00 27149.00 106.05 0.00 0.00 0.00 0.00 0.00 00:14:03.811 =================================================================================================================== 00:14:03.811 Total : 27149.00 106.05 0.00 0.00 0.00 0.00 0.00 00:14:03.811 00:14:04.752 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:04.752 Nvme0n1 : 9.00 27167.11 106.12 0.00 0.00 0.00 0.00 0.00 00:14:04.752 =================================================================================================================== 00:14:04.752 Total : 27167.11 106.12 0.00 0.00 0.00 0.00 0.00 00:14:04.752 00:14:05.739 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:05.739 Nvme0n1 : 10.00 27181.40 106.18 0.00 0.00 0.00 0.00 0.00 00:14:05.739 =================================================================================================================== 00:14:05.739 Total : 27181.40 106.18 0.00 0.00 0.00 0.00 0.00 00:14:05.739 00:14:05.739 00:14:05.739 Latency(us) 00:14:05.739 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:05.739 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:05.739 Nvme0n1 : 10.00 27180.01 106.17 0.00 0.00 4705.64 3577.17 12779.52 00:14:05.739 =================================================================================================================== 00:14:05.739 Total : 27180.01 106.17 0.00 0.00 4705.64 3577.17 12779.52 00:14:05.739 0 00:14:05.739 15:01:46 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3465879 00:14:05.739 15:01:46 -- common/autotest_common.sh@946 -- # '[' -z 3465879 ']' 00:14:05.739 15:01:46 -- common/autotest_common.sh@950 -- # kill -0 3465879 00:14:05.739 15:01:46 -- common/autotest_common.sh@951 -- # uname 00:14:05.739 15:01:46 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:05.739 15:01:46 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3465879 00:14:05.739 15:01:46 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:14:05.739 15:01:46 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:14:05.739 15:01:46 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3465879' 00:14:05.739 killing process with pid 3465879 00:14:05.739 15:01:46 -- common/autotest_common.sh@965 -- # kill 3465879 00:14:05.739 Received shutdown signal, test time was about 10.000000 seconds 00:14:05.739 00:14:05.739 Latency(us) 00:14:05.739 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:05.739 =================================================================================================================== 00:14:05.739 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:05.739 15:01:46 -- common/autotest_common.sh@970 -- # wait 3465879 00:14:05.739 15:01:46 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:06.073 15:01:46 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:06.073 15:01:46 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:06.073 15:01:46 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:06.073 15:01:46 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:06.073 15:01:46 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:06.334 [2024-04-26 15:01:47.130904] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:06.334 15:01:47 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:06.334 15:01:47 -- common/autotest_common.sh@648 -- # local es=0 00:14:06.334 15:01:47 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:06.334 15:01:47 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:06.334 15:01:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:06.334 15:01:47 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:06.334 15:01:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:06.334 15:01:47 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:06.334 15:01:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:06.334 15:01:47 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:06.334 15:01:47 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:14:06.334 15:01:47 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:06.595 request: 00:14:06.595 { 00:14:06.595 "uuid": "687b7c73-560a-468c-a236-534fcdb36789", 00:14:06.595 "method": "bdev_lvol_get_lvstores", 00:14:06.595 "req_id": 1 00:14:06.595 } 00:14:06.595 Got JSON-RPC error response 00:14:06.595 response: 00:14:06.595 { 00:14:06.595 "code": -19, 00:14:06.595 "message": "No such device" 00:14:06.595 } 00:14:06.595 15:01:47 -- common/autotest_common.sh@651 -- # es=1 00:14:06.595 15:01:47 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:14:06.595 15:01:47 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:14:06.595 15:01:47 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:14:06.595 15:01:47 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:06.595 aio_bdev 00:14:06.595 15:01:47 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a434dfe9-7473-42e7-8412-5aab56d6f74a 00:14:06.595 15:01:47 -- common/autotest_common.sh@895 -- # local bdev_name=a434dfe9-7473-42e7-8412-5aab56d6f74a 00:14:06.595 15:01:47 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:14:06.595 15:01:47 -- common/autotest_common.sh@897 -- # local i 00:14:06.595 15:01:47 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:14:06.595 15:01:47 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:14:06.595 15:01:47 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:06.856 15:01:47 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a434dfe9-7473-42e7-8412-5aab56d6f74a -t 2000 00:14:06.856 [ 00:14:06.856 { 00:14:06.856 "name": "a434dfe9-7473-42e7-8412-5aab56d6f74a", 00:14:06.856 "aliases": [ 00:14:06.856 "lvs/lvol" 00:14:06.856 ], 00:14:06.856 "product_name": "Logical Volume", 00:14:06.856 "block_size": 4096, 00:14:06.856 "num_blocks": 38912, 00:14:06.856 "uuid": "a434dfe9-7473-42e7-8412-5aab56d6f74a", 00:14:06.856 "assigned_rate_limits": { 00:14:06.856 "rw_ios_per_sec": 0, 00:14:06.856 "rw_mbytes_per_sec": 0, 00:14:06.856 "r_mbytes_per_sec": 0, 00:14:06.856 "w_mbytes_per_sec": 0 00:14:06.856 }, 00:14:06.856 "claimed": false, 00:14:06.856 "zoned": false, 00:14:06.856 "supported_io_types": { 00:14:06.856 "read": true, 00:14:06.856 "write": true, 00:14:06.856 "unmap": true, 00:14:06.856 "write_zeroes": true, 00:14:06.856 "flush": false, 00:14:06.856 "reset": true, 00:14:06.856 "compare": false, 00:14:06.856 "compare_and_write": false, 00:14:06.856 "abort": false, 00:14:06.856 "nvme_admin": false, 00:14:06.856 "nvme_io": false 00:14:06.856 }, 00:14:06.856 "driver_specific": { 00:14:06.856 "lvol": { 00:14:06.856 "lvol_store_uuid": "687b7c73-560a-468c-a236-534fcdb36789", 00:14:06.856 "base_bdev": "aio_bdev", 00:14:06.856 "thin_provision": false, 00:14:06.856 "snapshot": false, 00:14:06.856 "clone": false, 00:14:06.856 "esnap_clone": false 00:14:06.856 } 00:14:06.856 } 00:14:06.856 } 00:14:06.856 ] 00:14:06.856 15:01:47 -- common/autotest_common.sh@903 -- # return 0 00:14:06.856 15:01:47 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:06.856 15:01:47 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:07.117 15:01:47 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:07.117 15:01:47 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:07.117 15:01:47 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:07.378 15:01:48 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:07.378 15:01:48 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a434dfe9-7473-42e7-8412-5aab56d6f74a 00:14:07.378 15:01:48 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 687b7c73-560a-468c-a236-534fcdb36789 00:14:07.639 15:01:48 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:07.900 15:01:48 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:07.900 00:14:07.900 real 0m15.123s 00:14:07.900 user 0m15.151s 00:14:07.900 sys 0m0.869s 00:14:07.900 15:01:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:07.901 15:01:48 -- common/autotest_common.sh@10 -- # set +x 00:14:07.901 ************************************ 00:14:07.901 END TEST lvs_grow_clean 00:14:07.901 ************************************ 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:07.901 15:01:48 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:07.901 15:01:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:07.901 15:01:48 -- common/autotest_common.sh@10 -- # set +x 00:14:07.901 ************************************ 00:14:07.901 START TEST lvs_grow_dirty 00:14:07.901 ************************************ 00:14:07.901 15:01:48 -- common/autotest_common.sh@1121 -- # lvs_grow dirty 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:07.901 15:01:48 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:08.162 15:01:49 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:08.162 15:01:49 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:08.422 15:01:49 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:08.422 15:01:49 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:08.423 15:01:49 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:08.423 15:01:49 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:08.423 15:01:49 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:08.423 15:01:49 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ede1d854-1386-4f94-850b-69d0aa3daabf lvol 150 00:14:08.683 15:01:49 -- target/nvmf_lvs_grow.sh@33 -- # lvol=0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:08.683 15:01:49 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:08.683 15:01:49 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:08.683 [2024-04-26 15:01:49.588725] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:08.683 [2024-04-26 15:01:49.588778] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:08.683 true 00:14:08.683 15:01:49 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:08.683 15:01:49 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:08.943 15:01:49 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:08.943 15:01:49 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:09.205 15:01:49 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:09.205 15:01:50 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:14:09.466 15:01:50 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:09.466 15:01:50 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3468859 00:14:09.466 15:01:50 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:09.466 15:01:50 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3468859 /var/tmp/bdevperf.sock 00:14:09.466 15:01:50 -- common/autotest_common.sh@827 -- # '[' -z 3468859 ']' 00:14:09.466 15:01:50 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:09.466 15:01:50 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:09.466 15:01:50 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:09.466 15:01:50 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:09.466 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:09.466 15:01:50 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:09.466 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:14:09.466 [2024-04-26 15:01:50.396337] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:09.466 [2024-04-26 15:01:50.396388] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3468859 ] 00:14:09.728 EAL: No free 2048 kB hugepages reported on node 1 00:14:09.728 [2024-04-26 15:01:50.454246] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:09.728 [2024-04-26 15:01:50.516636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:10.300 15:01:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:10.300 15:01:51 -- common/autotest_common.sh@860 -- # return 0 00:14:10.300 15:01:51 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:10.561 Nvme0n1 00:14:10.561 15:01:51 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:10.821 [ 00:14:10.821 { 00:14:10.821 "name": "Nvme0n1", 00:14:10.821 "aliases": [ 00:14:10.821 "0e77df95-b6fa-4847-a473-e9ad37cd26d5" 00:14:10.821 ], 00:14:10.821 "product_name": "NVMe disk", 00:14:10.821 "block_size": 4096, 00:14:10.821 "num_blocks": 38912, 00:14:10.821 "uuid": "0e77df95-b6fa-4847-a473-e9ad37cd26d5", 00:14:10.821 "assigned_rate_limits": { 00:14:10.821 "rw_ios_per_sec": 0, 00:14:10.822 "rw_mbytes_per_sec": 0, 00:14:10.822 "r_mbytes_per_sec": 0, 00:14:10.822 "w_mbytes_per_sec": 0 00:14:10.822 }, 00:14:10.822 "claimed": false, 00:14:10.822 "zoned": false, 00:14:10.822 "supported_io_types": { 00:14:10.822 "read": true, 00:14:10.822 "write": true, 00:14:10.822 "unmap": true, 00:14:10.822 "write_zeroes": true, 00:14:10.822 "flush": true, 00:14:10.822 "reset": true, 00:14:10.822 "compare": true, 00:14:10.822 "compare_and_write": true, 00:14:10.822 "abort": true, 00:14:10.822 "nvme_admin": true, 00:14:10.822 "nvme_io": true 00:14:10.822 }, 00:14:10.822 "memory_domains": [ 00:14:10.822 { 00:14:10.822 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:14:10.822 "dma_device_type": 0 00:14:10.822 } 00:14:10.822 ], 00:14:10.822 "driver_specific": { 00:14:10.822 "nvme": [ 00:14:10.822 { 00:14:10.822 "trid": { 00:14:10.822 "trtype": "RDMA", 00:14:10.822 "adrfam": "IPv4", 00:14:10.822 "traddr": "192.168.100.8", 00:14:10.822 "trsvcid": "4420", 00:14:10.822 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:10.822 }, 00:14:10.822 "ctrlr_data": { 00:14:10.822 "cntlid": 1, 00:14:10.822 "vendor_id": "0x8086", 00:14:10.822 "model_number": "SPDK bdev Controller", 00:14:10.822 "serial_number": "SPDK0", 00:14:10.822 "firmware_revision": "24.05", 00:14:10.822 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:10.822 "oacs": { 00:14:10.822 "security": 0, 00:14:10.822 "format": 0, 00:14:10.822 "firmware": 0, 00:14:10.822 "ns_manage": 0 00:14:10.822 }, 00:14:10.822 "multi_ctrlr": true, 00:14:10.822 "ana_reporting": false 00:14:10.822 }, 00:14:10.822 "vs": { 00:14:10.822 "nvme_version": "1.3" 00:14:10.822 }, 00:14:10.822 "ns_data": { 00:14:10.822 "id": 1, 00:14:10.822 "can_share": true 00:14:10.822 } 00:14:10.822 } 00:14:10.822 ], 00:14:10.822 "mp_policy": "active_passive" 00:14:10.822 } 00:14:10.822 } 00:14:10.822 ] 00:14:10.822 15:01:51 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3469145 00:14:10.822 15:01:51 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:10.822 15:01:51 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:10.822 Running I/O for 10 seconds... 00:14:11.765 Latency(us) 00:14:11.765 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:11.765 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:11.765 Nvme0n1 : 1.00 26431.00 103.25 0.00 0.00 0.00 0.00 0.00 00:14:11.765 =================================================================================================================== 00:14:11.765 Total : 26431.00 103.25 0.00 0.00 0.00 0.00 0.00 00:14:11.765 00:14:12.707 15:01:53 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:12.968 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:12.968 Nvme0n1 : 2.00 26766.50 104.56 0.00 0.00 0.00 0.00 0.00 00:14:12.968 =================================================================================================================== 00:14:12.968 Total : 26766.50 104.56 0.00 0.00 0.00 0.00 0.00 00:14:12.968 00:14:12.968 true 00:14:12.968 15:01:53 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:12.968 15:01:53 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:12.968 15:01:53 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:12.968 15:01:53 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:12.968 15:01:53 -- target/nvmf_lvs_grow.sh@65 -- # wait 3469145 00:14:13.911 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:13.911 Nvme0n1 : 3.00 26881.67 105.01 0.00 0.00 0.00 0.00 0.00 00:14:13.911 =================================================================================================================== 00:14:13.911 Total : 26881.67 105.01 0.00 0.00 0.00 0.00 0.00 00:14:13.911 00:14:14.854 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:14.854 Nvme0n1 : 4.00 26969.00 105.35 0.00 0.00 0.00 0.00 0.00 00:14:14.854 =================================================================================================================== 00:14:14.854 Total : 26969.00 105.35 0.00 0.00 0.00 0.00 0.00 00:14:14.854 00:14:15.798 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:15.798 Nvme0n1 : 5.00 27026.60 105.57 0.00 0.00 0.00 0.00 0.00 00:14:15.798 =================================================================================================================== 00:14:15.798 Total : 27026.60 105.57 0.00 0.00 0.00 0.00 0.00 00:14:15.798 00:14:16.740 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:16.740 Nvme0n1 : 6.00 27071.50 105.75 0.00 0.00 0.00 0.00 0.00 00:14:16.740 =================================================================================================================== 00:14:16.740 Total : 27071.50 105.75 0.00 0.00 0.00 0.00 0.00 00:14:16.740 00:14:18.123 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.123 Nvme0n1 : 7.00 27103.57 105.87 0.00 0.00 0.00 0.00 0.00 00:14:18.123 =================================================================================================================== 00:14:18.123 Total : 27103.57 105.87 0.00 0.00 0.00 0.00 0.00 00:14:18.123 00:14:19.064 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.064 Nvme0n1 : 8.00 27127.62 105.97 0.00 0.00 0.00 0.00 0.00 00:14:19.064 =================================================================================================================== 00:14:19.064 Total : 27127.62 105.97 0.00 0.00 0.00 0.00 0.00 00:14:19.064 00:14:20.003 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.004 Nvme0n1 : 9.00 27136.22 106.00 0.00 0.00 0.00 0.00 0.00 00:14:20.004 =================================================================================================================== 00:14:20.004 Total : 27136.22 106.00 0.00 0.00 0.00 0.00 0.00 00:14:20.004 00:14:20.942 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.942 Nvme0n1 : 10.00 27152.20 106.06 0.00 0.00 0.00 0.00 0.00 00:14:20.942 =================================================================================================================== 00:14:20.942 Total : 27152.20 106.06 0.00 0.00 0.00 0.00 0.00 00:14:20.942 00:14:20.942 00:14:20.942 Latency(us) 00:14:20.942 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:20.942 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.942 Nvme0n1 : 10.00 27151.53 106.06 0.00 0.00 4710.22 3072.00 20971.52 00:14:20.942 =================================================================================================================== 00:14:20.942 Total : 27151.53 106.06 0.00 0.00 4710.22 3072.00 20971.52 00:14:20.942 0 00:14:20.942 15:02:01 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3468859 00:14:20.942 15:02:01 -- common/autotest_common.sh@946 -- # '[' -z 3468859 ']' 00:14:20.942 15:02:01 -- common/autotest_common.sh@950 -- # kill -0 3468859 00:14:20.942 15:02:01 -- common/autotest_common.sh@951 -- # uname 00:14:20.942 15:02:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:20.942 15:02:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3468859 00:14:20.942 15:02:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:14:20.942 15:02:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:14:20.942 15:02:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3468859' 00:14:20.942 killing process with pid 3468859 00:14:20.942 15:02:01 -- common/autotest_common.sh@965 -- # kill 3468859 00:14:20.942 Received shutdown signal, test time was about 10.000000 seconds 00:14:20.942 00:14:20.942 Latency(us) 00:14:20.942 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:20.942 =================================================================================================================== 00:14:20.942 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:20.942 15:02:01 -- common/autotest_common.sh@970 -- # wait 3468859 00:14:21.202 15:02:01 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:21.202 15:02:02 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:21.202 15:02:02 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3465323 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@74 -- # wait 3465323 00:14:21.462 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3465323 Killed "${NVMF_APP[@]}" "$@" 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:21.462 15:02:02 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:21.462 15:02:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:21.462 15:02:02 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:21.462 15:02:02 -- common/autotest_common.sh@10 -- # set +x 00:14:21.462 15:02:02 -- nvmf/common.sh@470 -- # nvmfpid=3471189 00:14:21.462 15:02:02 -- nvmf/common.sh@471 -- # waitforlisten 3471189 00:14:21.462 15:02:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:21.462 15:02:02 -- common/autotest_common.sh@827 -- # '[' -z 3471189 ']' 00:14:21.462 15:02:02 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:21.462 15:02:02 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:21.462 15:02:02 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:21.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:21.462 15:02:02 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:21.462 15:02:02 -- common/autotest_common.sh@10 -- # set +x 00:14:21.462 [2024-04-26 15:02:02.391690] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:21.462 [2024-04-26 15:02:02.391743] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:21.722 EAL: No free 2048 kB hugepages reported on node 1 00:14:21.722 [2024-04-26 15:02:02.452547] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:21.722 [2024-04-26 15:02:02.516719] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:21.722 [2024-04-26 15:02:02.516753] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:21.722 [2024-04-26 15:02:02.516760] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:21.722 [2024-04-26 15:02:02.516766] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:21.722 [2024-04-26 15:02:02.516772] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:21.722 [2024-04-26 15:02:02.516790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:22.293 15:02:03 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:22.293 15:02:03 -- common/autotest_common.sh@860 -- # return 0 00:14:22.293 15:02:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:22.293 15:02:03 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:22.293 15:02:03 -- common/autotest_common.sh@10 -- # set +x 00:14:22.293 15:02:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:22.293 15:02:03 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:22.554 [2024-04-26 15:02:03.337734] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:22.554 [2024-04-26 15:02:03.337816] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:22.554 [2024-04-26 15:02:03.337845] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:22.554 15:02:03 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:22.554 15:02:03 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:22.554 15:02:03 -- common/autotest_common.sh@895 -- # local bdev_name=0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:22.554 15:02:03 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:14:22.554 15:02:03 -- common/autotest_common.sh@897 -- # local i 00:14:22.554 15:02:03 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:14:22.554 15:02:03 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:14:22.554 15:02:03 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:22.815 15:02:03 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 0e77df95-b6fa-4847-a473-e9ad37cd26d5 -t 2000 00:14:22.815 [ 00:14:22.815 { 00:14:22.815 "name": "0e77df95-b6fa-4847-a473-e9ad37cd26d5", 00:14:22.815 "aliases": [ 00:14:22.815 "lvs/lvol" 00:14:22.815 ], 00:14:22.815 "product_name": "Logical Volume", 00:14:22.815 "block_size": 4096, 00:14:22.815 "num_blocks": 38912, 00:14:22.815 "uuid": "0e77df95-b6fa-4847-a473-e9ad37cd26d5", 00:14:22.815 "assigned_rate_limits": { 00:14:22.815 "rw_ios_per_sec": 0, 00:14:22.815 "rw_mbytes_per_sec": 0, 00:14:22.815 "r_mbytes_per_sec": 0, 00:14:22.815 "w_mbytes_per_sec": 0 00:14:22.815 }, 00:14:22.815 "claimed": false, 00:14:22.815 "zoned": false, 00:14:22.815 "supported_io_types": { 00:14:22.815 "read": true, 00:14:22.816 "write": true, 00:14:22.816 "unmap": true, 00:14:22.816 "write_zeroes": true, 00:14:22.816 "flush": false, 00:14:22.816 "reset": true, 00:14:22.816 "compare": false, 00:14:22.816 "compare_and_write": false, 00:14:22.816 "abort": false, 00:14:22.816 "nvme_admin": false, 00:14:22.816 "nvme_io": false 00:14:22.816 }, 00:14:22.816 "driver_specific": { 00:14:22.816 "lvol": { 00:14:22.816 "lvol_store_uuid": "ede1d854-1386-4f94-850b-69d0aa3daabf", 00:14:22.816 "base_bdev": "aio_bdev", 00:14:22.816 "thin_provision": false, 00:14:22.816 "snapshot": false, 00:14:22.816 "clone": false, 00:14:22.816 "esnap_clone": false 00:14:22.816 } 00:14:22.816 } 00:14:22.816 } 00:14:22.816 ] 00:14:22.816 15:02:03 -- common/autotest_common.sh@903 -- # return 0 00:14:22.816 15:02:03 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:22.816 15:02:03 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:23.076 15:02:03 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:23.076 15:02:03 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:23.076 15:02:03 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:23.076 15:02:03 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:23.076 15:02:03 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:23.336 [2024-04-26 15:02:04.089657] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:23.336 15:02:04 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:23.336 15:02:04 -- common/autotest_common.sh@648 -- # local es=0 00:14:23.336 15:02:04 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:23.336 15:02:04 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:23.336 15:02:04 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:23.336 15:02:04 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:23.336 15:02:04 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:23.336 15:02:04 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:23.336 15:02:04 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:14:23.336 15:02:04 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:23.336 15:02:04 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:14:23.336 15:02:04 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:23.336 request: 00:14:23.336 { 00:14:23.336 "uuid": "ede1d854-1386-4f94-850b-69d0aa3daabf", 00:14:23.336 "method": "bdev_lvol_get_lvstores", 00:14:23.336 "req_id": 1 00:14:23.336 } 00:14:23.336 Got JSON-RPC error response 00:14:23.336 response: 00:14:23.336 { 00:14:23.336 "code": -19, 00:14:23.336 "message": "No such device" 00:14:23.336 } 00:14:23.336 15:02:04 -- common/autotest_common.sh@651 -- # es=1 00:14:23.336 15:02:04 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:14:23.336 15:02:04 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:14:23.336 15:02:04 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:14:23.336 15:02:04 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:23.597 aio_bdev 00:14:23.597 15:02:04 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:23.597 15:02:04 -- common/autotest_common.sh@895 -- # local bdev_name=0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:23.597 15:02:04 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:14:23.597 15:02:04 -- common/autotest_common.sh@897 -- # local i 00:14:23.597 15:02:04 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:14:23.597 15:02:04 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:14:23.597 15:02:04 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:23.857 15:02:04 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 0e77df95-b6fa-4847-a473-e9ad37cd26d5 -t 2000 00:14:23.857 [ 00:14:23.857 { 00:14:23.857 "name": "0e77df95-b6fa-4847-a473-e9ad37cd26d5", 00:14:23.857 "aliases": [ 00:14:23.857 "lvs/lvol" 00:14:23.857 ], 00:14:23.857 "product_name": "Logical Volume", 00:14:23.857 "block_size": 4096, 00:14:23.857 "num_blocks": 38912, 00:14:23.857 "uuid": "0e77df95-b6fa-4847-a473-e9ad37cd26d5", 00:14:23.857 "assigned_rate_limits": { 00:14:23.857 "rw_ios_per_sec": 0, 00:14:23.857 "rw_mbytes_per_sec": 0, 00:14:23.857 "r_mbytes_per_sec": 0, 00:14:23.857 "w_mbytes_per_sec": 0 00:14:23.857 }, 00:14:23.857 "claimed": false, 00:14:23.857 "zoned": false, 00:14:23.857 "supported_io_types": { 00:14:23.857 "read": true, 00:14:23.857 "write": true, 00:14:23.857 "unmap": true, 00:14:23.857 "write_zeroes": true, 00:14:23.857 "flush": false, 00:14:23.857 "reset": true, 00:14:23.857 "compare": false, 00:14:23.857 "compare_and_write": false, 00:14:23.857 "abort": false, 00:14:23.857 "nvme_admin": false, 00:14:23.857 "nvme_io": false 00:14:23.857 }, 00:14:23.857 "driver_specific": { 00:14:23.857 "lvol": { 00:14:23.857 "lvol_store_uuid": "ede1d854-1386-4f94-850b-69d0aa3daabf", 00:14:23.857 "base_bdev": "aio_bdev", 00:14:23.857 "thin_provision": false, 00:14:23.857 "snapshot": false, 00:14:23.857 "clone": false, 00:14:23.857 "esnap_clone": false 00:14:23.857 } 00:14:23.857 } 00:14:23.857 } 00:14:23.857 ] 00:14:23.857 15:02:04 -- common/autotest_common.sh@903 -- # return 0 00:14:23.857 15:02:04 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:23.857 15:02:04 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:24.117 15:02:04 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:24.117 15:02:04 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:24.117 15:02:04 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:24.117 15:02:05 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:24.117 15:02:05 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 0e77df95-b6fa-4847-a473-e9ad37cd26d5 00:14:24.378 15:02:05 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ede1d854-1386-4f94-850b-69d0aa3daabf 00:14:24.639 15:02:05 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:24.639 15:02:05 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:24.639 00:14:24.639 real 0m16.699s 00:14:24.639 user 0m44.489s 00:14:24.639 sys 0m2.339s 00:14:24.639 15:02:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:24.639 15:02:05 -- common/autotest_common.sh@10 -- # set +x 00:14:24.639 ************************************ 00:14:24.639 END TEST lvs_grow_dirty 00:14:24.639 ************************************ 00:14:24.639 15:02:05 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:24.639 15:02:05 -- common/autotest_common.sh@804 -- # type=--id 00:14:24.639 15:02:05 -- common/autotest_common.sh@805 -- # id=0 00:14:24.639 15:02:05 -- common/autotest_common.sh@806 -- # '[' --id = --pid ']' 00:14:24.639 15:02:05 -- common/autotest_common.sh@810 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:24.639 15:02:05 -- common/autotest_common.sh@810 -- # shm_files=nvmf_trace.0 00:14:24.639 15:02:05 -- common/autotest_common.sh@812 -- # [[ -z nvmf_trace.0 ]] 00:14:24.639 15:02:05 -- common/autotest_common.sh@816 -- # for n in $shm_files 00:14:24.639 15:02:05 -- common/autotest_common.sh@817 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:24.639 nvmf_trace.0 00:14:24.899 15:02:05 -- common/autotest_common.sh@819 -- # return 0 00:14:24.899 15:02:05 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:24.899 15:02:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:24.899 15:02:05 -- nvmf/common.sh@117 -- # sync 00:14:24.899 15:02:05 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:24.899 15:02:05 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:24.899 15:02:05 -- nvmf/common.sh@120 -- # set +e 00:14:24.899 15:02:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:24.899 15:02:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:24.899 rmmod nvme_rdma 00:14:24.899 rmmod nvme_fabrics 00:14:24.899 15:02:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:24.899 15:02:05 -- nvmf/common.sh@124 -- # set -e 00:14:24.900 15:02:05 -- nvmf/common.sh@125 -- # return 0 00:14:24.900 15:02:05 -- nvmf/common.sh@478 -- # '[' -n 3471189 ']' 00:14:24.900 15:02:05 -- nvmf/common.sh@479 -- # killprocess 3471189 00:14:24.900 15:02:05 -- common/autotest_common.sh@946 -- # '[' -z 3471189 ']' 00:14:24.900 15:02:05 -- common/autotest_common.sh@950 -- # kill -0 3471189 00:14:24.900 15:02:05 -- common/autotest_common.sh@951 -- # uname 00:14:24.900 15:02:05 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:24.900 15:02:05 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3471189 00:14:24.900 15:02:05 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:14:24.900 15:02:05 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:14:24.900 15:02:05 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3471189' 00:14:24.900 killing process with pid 3471189 00:14:24.900 15:02:05 -- common/autotest_common.sh@965 -- # kill 3471189 00:14:24.900 15:02:05 -- common/autotest_common.sh@970 -- # wait 3471189 00:14:24.900 15:02:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:24.900 15:02:05 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:24.900 00:14:24.900 real 0m40.428s 00:14:24.900 user 1m5.498s 00:14:24.900 sys 0m8.733s 00:14:24.900 15:02:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:24.900 15:02:05 -- common/autotest_common.sh@10 -- # set +x 00:14:24.900 ************************************ 00:14:24.900 END TEST nvmf_lvs_grow 00:14:24.900 ************************************ 00:14:25.161 15:02:05 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:14:25.161 15:02:05 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:25.161 15:02:05 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:25.161 15:02:05 -- common/autotest_common.sh@10 -- # set +x 00:14:25.161 ************************************ 00:14:25.161 START TEST nvmf_bdev_io_wait 00:14:25.161 ************************************ 00:14:25.161 15:02:06 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:14:25.423 * Looking for test storage... 00:14:25.423 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:25.423 15:02:06 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:25.423 15:02:06 -- nvmf/common.sh@7 -- # uname -s 00:14:25.423 15:02:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:25.423 15:02:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:25.423 15:02:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:25.423 15:02:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:25.423 15:02:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:25.423 15:02:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:25.423 15:02:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:25.423 15:02:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:25.423 15:02:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:25.423 15:02:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:25.423 15:02:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:25.423 15:02:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:25.423 15:02:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:25.423 15:02:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:25.423 15:02:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:25.423 15:02:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:25.423 15:02:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:25.423 15:02:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:25.423 15:02:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:25.423 15:02:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:25.424 15:02:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.424 15:02:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.424 15:02:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.424 15:02:06 -- paths/export.sh@5 -- # export PATH 00:14:25.424 15:02:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.424 15:02:06 -- nvmf/common.sh@47 -- # : 0 00:14:25.424 15:02:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:25.424 15:02:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:25.424 15:02:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:25.424 15:02:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:25.424 15:02:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:25.424 15:02:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:25.424 15:02:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:25.424 15:02:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:25.424 15:02:06 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:25.424 15:02:06 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:25.424 15:02:06 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:25.424 15:02:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:25.424 15:02:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:25.424 15:02:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:25.424 15:02:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:25.424 15:02:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:25.424 15:02:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.424 15:02:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.424 15:02:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.424 15:02:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:25.424 15:02:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:25.424 15:02:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:25.424 15:02:06 -- common/autotest_common.sh@10 -- # set +x 00:14:32.021 15:02:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.021 15:02:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:32.021 15:02:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:32.021 15:02:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:32.021 15:02:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:32.021 15:02:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:32.021 15:02:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:32.021 15:02:12 -- nvmf/common.sh@295 -- # net_devs=() 00:14:32.021 15:02:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:32.021 15:02:12 -- nvmf/common.sh@296 -- # e810=() 00:14:32.021 15:02:12 -- nvmf/common.sh@296 -- # local -ga e810 00:14:32.021 15:02:12 -- nvmf/common.sh@297 -- # x722=() 00:14:32.021 15:02:12 -- nvmf/common.sh@297 -- # local -ga x722 00:14:32.021 15:02:12 -- nvmf/common.sh@298 -- # mlx=() 00:14:32.021 15:02:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:32.021 15:02:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.021 15:02:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:32.021 15:02:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.021 15:02:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:14:32.021 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:14:32.021 15:02:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.021 15:02:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.021 15:02:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:14:32.021 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:14:32.021 15:02:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.021 15:02:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:32.021 15:02:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.021 15:02:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.021 15:02:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.021 15:02:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.021 15:02:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:14:32.021 Found net devices under 0000:31:00.0: mlx_0_0 00:14:32.021 15:02:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.021 15:02:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.021 15:02:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.021 15:02:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.021 15:02:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:14:32.021 Found net devices under 0000:31:00.1: mlx_0_1 00:14:32.021 15:02:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.021 15:02:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:32.021 15:02:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:32.021 15:02:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:32.021 15:02:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:32.021 15:02:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:32.021 15:02:12 -- nvmf/common.sh@58 -- # uname 00:14:32.021 15:02:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:32.021 15:02:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:32.021 15:02:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:32.021 15:02:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:32.021 15:02:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:32.021 15:02:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:32.021 15:02:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:32.021 15:02:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:32.283 15:02:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:32.283 15:02:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:32.283 15:02:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:32.283 15:02:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.283 15:02:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.283 15:02:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.283 15:02:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.283 15:02:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.283 15:02:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@105 -- # continue 2 00:14:32.283 15:02:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@105 -- # continue 2 00:14:32.283 15:02:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.283 15:02:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.283 15:02:13 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:32.283 15:02:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:32.283 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:32.283 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:14:32.283 altname enp49s0f0np0 00:14:32.283 altname ens786f0np0 00:14:32.283 inet 192.168.100.8/24 scope global mlx_0_0 00:14:32.283 valid_lft forever preferred_lft forever 00:14:32.283 15:02:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.283 15:02:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.283 15:02:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:32.283 15:02:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:32.283 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:32.283 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:14:32.283 altname enp49s0f1np1 00:14:32.283 altname ens786f1np1 00:14:32.283 inet 192.168.100.9/24 scope global mlx_0_1 00:14:32.283 valid_lft forever preferred_lft forever 00:14:32.283 15:02:13 -- nvmf/common.sh@411 -- # return 0 00:14:32.283 15:02:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:32.283 15:02:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:32.283 15:02:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:32.283 15:02:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:32.283 15:02:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.283 15:02:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.283 15:02:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.283 15:02:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.283 15:02:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.283 15:02:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@105 -- # continue 2 00:14:32.283 15:02:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.283 15:02:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:32.283 15:02:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@105 -- # continue 2 00:14:32.283 15:02:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.283 15:02:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.283 15:02:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.283 15:02:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.283 15:02:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.283 15:02:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:32.283 192.168.100.9' 00:14:32.283 15:02:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:32.283 192.168.100.9' 00:14:32.283 15:02:13 -- nvmf/common.sh@446 -- # head -n 1 00:14:32.283 15:02:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:32.283 15:02:13 -- nvmf/common.sh@447 -- # tail -n +2 00:14:32.283 15:02:13 -- nvmf/common.sh@447 -- # head -n 1 00:14:32.283 15:02:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:32.283 192.168.100.9' 00:14:32.283 15:02:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:32.283 15:02:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:32.283 15:02:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:32.283 15:02:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:32.283 15:02:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:32.283 15:02:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:32.283 15:02:13 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:32.283 15:02:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:32.283 15:02:13 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:32.283 15:02:13 -- common/autotest_common.sh@10 -- # set +x 00:14:32.283 15:02:13 -- nvmf/common.sh@470 -- # nvmfpid=3475682 00:14:32.283 15:02:13 -- nvmf/common.sh@471 -- # waitforlisten 3475682 00:14:32.283 15:02:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:32.283 15:02:13 -- common/autotest_common.sh@827 -- # '[' -z 3475682 ']' 00:14:32.283 15:02:13 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.283 15:02:13 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:32.283 15:02:13 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.283 15:02:13 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:32.283 15:02:13 -- common/autotest_common.sh@10 -- # set +x 00:14:32.283 [2024-04-26 15:02:13.213476] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:32.283 [2024-04-26 15:02:13.213543] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.544 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.544 [2024-04-26 15:02:13.278193] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:32.544 [2024-04-26 15:02:13.352949] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.544 [2024-04-26 15:02:13.352992] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.544 [2024-04-26 15:02:13.353001] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:32.544 [2024-04-26 15:02:13.353008] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:32.544 [2024-04-26 15:02:13.353015] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.544 [2024-04-26 15:02:13.353154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.544 [2024-04-26 15:02:13.353285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:32.544 [2024-04-26 15:02:13.353407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:32.544 [2024-04-26 15:02:13.353410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:33.114 15:02:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:33.114 15:02:13 -- common/autotest_common.sh@860 -- # return 0 00:14:33.114 15:02:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:33.114 15:02:13 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:33.114 15:02:13 -- common/autotest_common.sh@10 -- # set +x 00:14:33.114 15:02:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:33.114 15:02:14 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:33.114 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.114 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.114 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.114 15:02:14 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:33.114 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.114 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.375 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.375 15:02:14 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:33.375 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.375 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.375 [2024-04-26 15:02:14.134804] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1590ae0/0x1594fd0) succeed. 00:14:33.375 [2024-04-26 15:02:14.147877] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1592120/0x15d6660) succeed. 00:14:33.375 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.375 15:02:14 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:33.375 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.375 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.375 Malloc0 00:14:33.375 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.375 15:02:14 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:33.375 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.375 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.375 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.375 15:02:14 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:33.375 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.375 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.375 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.375 15:02:14 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:33.375 15:02:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:33.375 15:02:14 -- common/autotest_common.sh@10 -- # set +x 00:14:33.637 [2024-04-26 15:02:14.328678] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:33.637 15:02:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3475922 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@30 -- # READ_PID=3475924 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # config=() 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # local subsystem config 00:14:33.637 15:02:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:33.637 { 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme$subsystem", 00:14:33.637 "trtype": "$TEST_TRANSPORT", 00:14:33.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "$NVMF_PORT", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:33.637 "hdgst": ${hdgst:-false}, 00:14:33.637 "ddgst": ${ddgst:-false} 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 } 00:14:33.637 EOF 00:14:33.637 )") 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3475926 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # config=() 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # local subsystem config 00:14:33.637 15:02:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:33.637 { 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme$subsystem", 00:14:33.637 "trtype": "$TEST_TRANSPORT", 00:14:33.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "$NVMF_PORT", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:33.637 "hdgst": ${hdgst:-false}, 00:14:33.637 "ddgst": ${ddgst:-false} 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 } 00:14:33.637 EOF 00:14:33.637 )") 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3475929 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@35 -- # sync 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # cat 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # config=() 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # local subsystem config 00:14:33.637 15:02:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:33.637 { 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme$subsystem", 00:14:33.637 "trtype": "$TEST_TRANSPORT", 00:14:33.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "$NVMF_PORT", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:33.637 "hdgst": ${hdgst:-false}, 00:14:33.637 "ddgst": ${ddgst:-false} 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 } 00:14:33.637 EOF 00:14:33.637 )") 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # config=() 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # cat 00:14:33.637 15:02:14 -- nvmf/common.sh@521 -- # local subsystem config 00:14:33.637 15:02:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:33.637 { 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme$subsystem", 00:14:33.637 "trtype": "$TEST_TRANSPORT", 00:14:33.637 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "$NVMF_PORT", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:33.637 "hdgst": ${hdgst:-false}, 00:14:33.637 "ddgst": ${ddgst:-false} 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 } 00:14:33.637 EOF 00:14:33.637 )") 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # cat 00:14:33.637 15:02:14 -- target/bdev_io_wait.sh@37 -- # wait 3475922 00:14:33.637 15:02:14 -- nvmf/common.sh@543 -- # cat 00:14:33.637 15:02:14 -- nvmf/common.sh@545 -- # jq . 00:14:33.637 15:02:14 -- nvmf/common.sh@545 -- # jq . 00:14:33.637 15:02:14 -- nvmf/common.sh@545 -- # jq . 00:14:33.637 15:02:14 -- nvmf/common.sh@546 -- # IFS=, 00:14:33.637 15:02:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme1", 00:14:33.637 "trtype": "rdma", 00:14:33.637 "traddr": "192.168.100.8", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "4420", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:33.637 "hdgst": false, 00:14:33.637 "ddgst": false 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 }' 00:14:33.637 15:02:14 -- nvmf/common.sh@545 -- # jq . 00:14:33.637 15:02:14 -- nvmf/common.sh@546 -- # IFS=, 00:14:33.637 15:02:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme1", 00:14:33.637 "trtype": "rdma", 00:14:33.637 "traddr": "192.168.100.8", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "4420", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:33.637 "hdgst": false, 00:14:33.637 "ddgst": false 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 }' 00:14:33.637 15:02:14 -- nvmf/common.sh@546 -- # IFS=, 00:14:33.637 15:02:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme1", 00:14:33.637 "trtype": "rdma", 00:14:33.637 "traddr": "192.168.100.8", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "4420", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:33.637 "hdgst": false, 00:14:33.637 "ddgst": false 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 }' 00:14:33.637 15:02:14 -- nvmf/common.sh@546 -- # IFS=, 00:14:33.637 15:02:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:33.637 "params": { 00:14:33.637 "name": "Nvme1", 00:14:33.637 "trtype": "rdma", 00:14:33.637 "traddr": "192.168.100.8", 00:14:33.637 "adrfam": "ipv4", 00:14:33.637 "trsvcid": "4420", 00:14:33.637 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:33.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:33.637 "hdgst": false, 00:14:33.637 "ddgst": false 00:14:33.637 }, 00:14:33.637 "method": "bdev_nvme_attach_controller" 00:14:33.637 }' 00:14:33.637 [2024-04-26 15:02:14.377574] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:33.637 [2024-04-26 15:02:14.377628] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:33.637 [2024-04-26 15:02:14.378721] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:33.637 [2024-04-26 15:02:14.378766] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:33.637 [2024-04-26 15:02:14.381738] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:33.638 [2024-04-26 15:02:14.381780] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:33.638 [2024-04-26 15:02:14.383597] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:33.638 [2024-04-26 15:02:14.383643] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:33.638 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.638 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.638 [2024-04-26 15:02:14.521621] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.638 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.638 [2024-04-26 15:02:14.571352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:33.638 [2024-04-26 15:02:14.576299] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.898 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.898 [2024-04-26 15:02:14.624314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:33.898 [2024-04-26 15:02:14.639759] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.898 [2024-04-26 15:02:14.688832] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.898 [2024-04-26 15:02:14.689794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:33.898 [2024-04-26 15:02:14.736385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:33.898 Running I/O for 1 seconds... 00:14:33.898 Running I/O for 1 seconds... 00:14:33.898 Running I/O for 1 seconds... 00:14:34.159 Running I/O for 1 seconds... 00:14:35.164 00:14:35.164 Latency(us) 00:14:35.164 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:35.164 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:35.164 Nvme1n1 : 1.00 18751.20 73.25 0.00 0.00 6805.42 4642.13 23046.83 00:14:35.164 =================================================================================================================== 00:14:35.164 Total : 18751.20 73.25 0.00 0.00 6805.42 4642.13 23046.83 00:14:35.164 00:14:35.164 Latency(us) 00:14:35.164 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:35.164 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:35.164 Nvme1n1 : 1.01 16738.06 65.38 0.00 0.00 7619.23 4833.28 24794.45 00:14:35.164 =================================================================================================================== 00:14:35.164 Total : 16738.06 65.38 0.00 0.00 7619.23 4833.28 24794.45 00:14:35.164 00:14:35.164 Latency(us) 00:14:35.164 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:35.164 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:35.164 Nvme1n1 : 1.00 19508.13 76.20 0.00 0.00 6544.31 3822.93 18459.31 00:14:35.164 =================================================================================================================== 00:14:35.164 Total : 19508.13 76.20 0.00 0.00 6544.31 3822.93 18459.31 00:14:35.164 00:14:35.164 Latency(us) 00:14:35.164 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:35.164 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:35.164 Nvme1n1 : 1.00 193764.13 756.89 0.00 0.00 658.11 254.29 2498.56 00:14:35.164 =================================================================================================================== 00:14:35.164 Total : 193764.13 756.89 0.00 0.00 658.11 254.29 2498.56 00:14:35.164 15:02:15 -- target/bdev_io_wait.sh@38 -- # wait 3475924 00:14:35.164 15:02:16 -- target/bdev_io_wait.sh@39 -- # wait 3475926 00:14:35.164 15:02:16 -- target/bdev_io_wait.sh@40 -- # wait 3475929 00:14:35.164 15:02:16 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:35.164 15:02:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:35.164 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:14:35.164 15:02:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:35.164 15:02:16 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:35.164 15:02:16 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:35.164 15:02:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:35.164 15:02:16 -- nvmf/common.sh@117 -- # sync 00:14:35.164 15:02:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:35.164 15:02:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:35.164 15:02:16 -- nvmf/common.sh@120 -- # set +e 00:14:35.164 15:02:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:35.164 15:02:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:35.164 rmmod nvme_rdma 00:14:35.425 rmmod nvme_fabrics 00:14:35.425 15:02:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:35.425 15:02:16 -- nvmf/common.sh@124 -- # set -e 00:14:35.425 15:02:16 -- nvmf/common.sh@125 -- # return 0 00:14:35.425 15:02:16 -- nvmf/common.sh@478 -- # '[' -n 3475682 ']' 00:14:35.425 15:02:16 -- nvmf/common.sh@479 -- # killprocess 3475682 00:14:35.425 15:02:16 -- common/autotest_common.sh@946 -- # '[' -z 3475682 ']' 00:14:35.425 15:02:16 -- common/autotest_common.sh@950 -- # kill -0 3475682 00:14:35.425 15:02:16 -- common/autotest_common.sh@951 -- # uname 00:14:35.425 15:02:16 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:35.425 15:02:16 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3475682 00:14:35.425 15:02:16 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:14:35.425 15:02:16 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:14:35.425 15:02:16 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3475682' 00:14:35.425 killing process with pid 3475682 00:14:35.425 15:02:16 -- common/autotest_common.sh@965 -- # kill 3475682 00:14:35.425 15:02:16 -- common/autotest_common.sh@970 -- # wait 3475682 00:14:35.425 [2024-04-26 15:02:16.272941] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:35.687 15:02:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:35.687 15:02:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:35.687 00:14:35.687 real 0m10.353s 00:14:35.687 user 0m19.607s 00:14:35.687 sys 0m6.240s 00:14:35.687 15:02:16 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:35.687 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:14:35.687 ************************************ 00:14:35.687 END TEST nvmf_bdev_io_wait 00:14:35.687 ************************************ 00:14:35.687 15:02:16 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:14:35.687 15:02:16 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:35.687 15:02:16 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:35.687 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:14:35.687 ************************************ 00:14:35.687 START TEST nvmf_queue_depth 00:14:35.687 ************************************ 00:14:35.687 15:02:16 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:14:35.948 * Looking for test storage... 00:14:35.948 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:35.948 15:02:16 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:35.948 15:02:16 -- nvmf/common.sh@7 -- # uname -s 00:14:35.948 15:02:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:35.948 15:02:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:35.948 15:02:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:35.948 15:02:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:35.948 15:02:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:35.948 15:02:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:35.948 15:02:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:35.948 15:02:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:35.948 15:02:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:35.948 15:02:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:35.948 15:02:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:35.948 15:02:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:35.948 15:02:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:35.948 15:02:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:35.948 15:02:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:35.948 15:02:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:35.948 15:02:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:35.948 15:02:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:35.948 15:02:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:35.948 15:02:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:35.948 15:02:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.948 15:02:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.948 15:02:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.948 15:02:16 -- paths/export.sh@5 -- # export PATH 00:14:35.948 15:02:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.948 15:02:16 -- nvmf/common.sh@47 -- # : 0 00:14:35.948 15:02:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:35.948 15:02:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:35.948 15:02:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:35.948 15:02:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:35.948 15:02:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:35.948 15:02:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:35.948 15:02:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:35.948 15:02:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:35.948 15:02:16 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:14:35.949 15:02:16 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:14:35.949 15:02:16 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:35.949 15:02:16 -- target/queue_depth.sh@19 -- # nvmftestinit 00:14:35.949 15:02:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:35.949 15:02:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:35.949 15:02:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:35.949 15:02:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:35.949 15:02:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:35.949 15:02:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.949 15:02:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:35.949 15:02:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.949 15:02:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:35.949 15:02:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:35.949 15:02:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:35.949 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:14:42.537 15:02:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:42.537 15:02:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:42.537 15:02:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:42.537 15:02:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:42.537 15:02:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:42.537 15:02:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:42.537 15:02:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:42.537 15:02:23 -- nvmf/common.sh@295 -- # net_devs=() 00:14:42.537 15:02:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:42.537 15:02:23 -- nvmf/common.sh@296 -- # e810=() 00:14:42.537 15:02:23 -- nvmf/common.sh@296 -- # local -ga e810 00:14:42.537 15:02:23 -- nvmf/common.sh@297 -- # x722=() 00:14:42.537 15:02:23 -- nvmf/common.sh@297 -- # local -ga x722 00:14:42.537 15:02:23 -- nvmf/common.sh@298 -- # mlx=() 00:14:42.537 15:02:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:42.537 15:02:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:42.537 15:02:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:42.537 15:02:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:42.537 15:02:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:14:42.537 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:14:42.537 15:02:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:42.537 15:02:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:42.537 15:02:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:14:42.537 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:14:42.537 15:02:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:42.537 15:02:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:42.537 15:02:23 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:42.537 15:02:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.537 15:02:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:42.537 15:02:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.537 15:02:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:14:42.537 Found net devices under 0000:31:00.0: mlx_0_0 00:14:42.537 15:02:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:42.537 15:02:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.537 15:02:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:42.537 15:02:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.537 15:02:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:14:42.537 Found net devices under 0000:31:00.1: mlx_0_1 00:14:42.537 15:02:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.537 15:02:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:42.537 15:02:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:42.537 15:02:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:42.537 15:02:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:42.537 15:02:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:42.537 15:02:23 -- nvmf/common.sh@58 -- # uname 00:14:42.537 15:02:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:42.537 15:02:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:42.537 15:02:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:42.537 15:02:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:42.537 15:02:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:42.537 15:02:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:42.537 15:02:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:42.537 15:02:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:42.537 15:02:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:42.537 15:02:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:42.538 15:02:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:42.538 15:02:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:42.538 15:02:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:42.538 15:02:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:42.538 15:02:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:42.538 15:02:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:42.538 15:02:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@105 -- # continue 2 00:14:42.538 15:02:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@105 -- # continue 2 00:14:42.538 15:02:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:42.538 15:02:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:42.538 15:02:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:42.538 15:02:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:42.538 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:42.538 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:14:42.538 altname enp49s0f0np0 00:14:42.538 altname ens786f0np0 00:14:42.538 inet 192.168.100.8/24 scope global mlx_0_0 00:14:42.538 valid_lft forever preferred_lft forever 00:14:42.538 15:02:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:42.538 15:02:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:42.538 15:02:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:42.538 15:02:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:42.538 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:42.538 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:14:42.538 altname enp49s0f1np1 00:14:42.538 altname ens786f1np1 00:14:42.538 inet 192.168.100.9/24 scope global mlx_0_1 00:14:42.538 valid_lft forever preferred_lft forever 00:14:42.538 15:02:23 -- nvmf/common.sh@411 -- # return 0 00:14:42.538 15:02:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:42.538 15:02:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:42.538 15:02:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:42.538 15:02:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:42.538 15:02:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:42.538 15:02:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:42.538 15:02:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:42.538 15:02:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:42.538 15:02:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:42.538 15:02:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@105 -- # continue 2 00:14:42.538 15:02:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:42.538 15:02:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:42.538 15:02:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@105 -- # continue 2 00:14:42.538 15:02:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:42.538 15:02:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:42.538 15:02:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:42.538 15:02:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:42.538 15:02:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:42.538 15:02:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:42.538 192.168.100.9' 00:14:42.538 15:02:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:42.538 192.168.100.9' 00:14:42.538 15:02:23 -- nvmf/common.sh@446 -- # head -n 1 00:14:42.538 15:02:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:42.538 15:02:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:42.538 192.168.100.9' 00:14:42.538 15:02:23 -- nvmf/common.sh@447 -- # tail -n +2 00:14:42.538 15:02:23 -- nvmf/common.sh@447 -- # head -n 1 00:14:42.538 15:02:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:42.538 15:02:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:42.538 15:02:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:42.538 15:02:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:42.538 15:02:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:42.538 15:02:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:42.538 15:02:23 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:14:42.538 15:02:23 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:42.538 15:02:23 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:42.538 15:02:23 -- common/autotest_common.sh@10 -- # set +x 00:14:42.538 15:02:23 -- nvmf/common.sh@470 -- # nvmfpid=3480097 00:14:42.538 15:02:23 -- nvmf/common.sh@471 -- # waitforlisten 3480097 00:14:42.538 15:02:23 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:42.538 15:02:23 -- common/autotest_common.sh@827 -- # '[' -z 3480097 ']' 00:14:42.538 15:02:23 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:42.538 15:02:23 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:42.538 15:02:23 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:42.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:42.538 15:02:23 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:42.538 15:02:23 -- common/autotest_common.sh@10 -- # set +x 00:14:42.538 [2024-04-26 15:02:23.421827] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:42.538 [2024-04-26 15:02:23.421877] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:42.538 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.538 [2024-04-26 15:02:23.480384] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:42.798 [2024-04-26 15:02:23.543744] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:42.798 [2024-04-26 15:02:23.543777] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:42.798 [2024-04-26 15:02:23.543784] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:42.798 [2024-04-26 15:02:23.543791] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:42.798 [2024-04-26 15:02:23.543796] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:42.798 [2024-04-26 15:02:23.543815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:43.371 15:02:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:43.371 15:02:24 -- common/autotest_common.sh@860 -- # return 0 00:14:43.371 15:02:24 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:43.371 15:02:24 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:43.371 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.371 15:02:24 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:43.371 15:02:24 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:43.371 15:02:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:43.371 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.371 [2024-04-26 15:02:24.254848] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x233dca0/0x2342190) succeed. 00:14:43.371 [2024-04-26 15:02:24.267869] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x233f1a0/0x2383820) succeed. 00:14:43.371 15:02:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:43.371 15:02:24 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:43.371 15:02:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:43.371 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.633 Malloc0 00:14:43.633 15:02:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:43.633 15:02:24 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:43.633 15:02:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:43.633 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.633 15:02:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:43.633 15:02:24 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:43.633 15:02:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:43.633 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.633 15:02:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:43.633 15:02:24 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:43.633 15:02:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:43.633 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.633 [2024-04-26 15:02:24.345294] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:43.633 15:02:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:43.633 15:02:24 -- target/queue_depth.sh@30 -- # bdevperf_pid=3480286 00:14:43.633 15:02:24 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:43.633 15:02:24 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:14:43.633 15:02:24 -- target/queue_depth.sh@33 -- # waitforlisten 3480286 /var/tmp/bdevperf.sock 00:14:43.633 15:02:24 -- common/autotest_common.sh@827 -- # '[' -z 3480286 ']' 00:14:43.633 15:02:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:43.633 15:02:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:43.633 15:02:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:43.633 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:43.633 15:02:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:43.633 15:02:24 -- common/autotest_common.sh@10 -- # set +x 00:14:43.633 [2024-04-26 15:02:24.396013] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:14:43.633 [2024-04-26 15:02:24.396065] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3480286 ] 00:14:43.633 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.633 [2024-04-26 15:02:24.455015] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:43.633 [2024-04-26 15:02:24.517400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:44.576 15:02:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:44.576 15:02:25 -- common/autotest_common.sh@860 -- # return 0 00:14:44.576 15:02:25 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:14:44.576 15:02:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:44.576 15:02:25 -- common/autotest_common.sh@10 -- # set +x 00:14:44.576 NVMe0n1 00:14:44.576 15:02:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:44.576 15:02:25 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:44.576 Running I/O for 10 seconds... 00:14:54.579 00:14:54.579 Latency(us) 00:14:54.579 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:54.579 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:14:54.579 Verification LBA range: start 0x0 length 0x4000 00:14:54.579 NVMe0n1 : 10.05 13208.31 51.59 0.00 0.00 77232.86 20425.39 48715.09 00:14:54.579 =================================================================================================================== 00:14:54.579 Total : 13208.31 51.59 0.00 0.00 77232.86 20425.39 48715.09 00:14:54.579 0 00:14:54.579 15:02:35 -- target/queue_depth.sh@39 -- # killprocess 3480286 00:14:54.579 15:02:35 -- common/autotest_common.sh@946 -- # '[' -z 3480286 ']' 00:14:54.579 15:02:35 -- common/autotest_common.sh@950 -- # kill -0 3480286 00:14:54.579 15:02:35 -- common/autotest_common.sh@951 -- # uname 00:14:54.579 15:02:35 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:54.579 15:02:35 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3480286 00:14:54.579 15:02:35 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:14:54.579 15:02:35 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:14:54.579 15:02:35 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3480286' 00:14:54.579 killing process with pid 3480286 00:14:54.579 15:02:35 -- common/autotest_common.sh@965 -- # kill 3480286 00:14:54.579 Received shutdown signal, test time was about 10.000000 seconds 00:14:54.579 00:14:54.579 Latency(us) 00:14:54.579 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:54.579 =================================================================================================================== 00:14:54.579 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:54.579 15:02:35 -- common/autotest_common.sh@970 -- # wait 3480286 00:14:54.840 15:02:35 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:54.840 15:02:35 -- target/queue_depth.sh@43 -- # nvmftestfini 00:14:54.840 15:02:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:54.840 15:02:35 -- nvmf/common.sh@117 -- # sync 00:14:54.840 15:02:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:54.840 15:02:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:54.840 15:02:35 -- nvmf/common.sh@120 -- # set +e 00:14:54.840 15:02:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:54.840 15:02:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:54.840 rmmod nvme_rdma 00:14:54.840 rmmod nvme_fabrics 00:14:54.840 15:02:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:54.840 15:02:35 -- nvmf/common.sh@124 -- # set -e 00:14:54.840 15:02:35 -- nvmf/common.sh@125 -- # return 0 00:14:54.840 15:02:35 -- nvmf/common.sh@478 -- # '[' -n 3480097 ']' 00:14:54.840 15:02:35 -- nvmf/common.sh@479 -- # killprocess 3480097 00:14:54.840 15:02:35 -- common/autotest_common.sh@946 -- # '[' -z 3480097 ']' 00:14:54.840 15:02:35 -- common/autotest_common.sh@950 -- # kill -0 3480097 00:14:54.840 15:02:35 -- common/autotest_common.sh@951 -- # uname 00:14:54.841 15:02:35 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:54.841 15:02:35 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3480097 00:14:54.841 15:02:35 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:14:54.841 15:02:35 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:14:54.841 15:02:35 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3480097' 00:14:54.841 killing process with pid 3480097 00:14:54.841 15:02:35 -- common/autotest_common.sh@965 -- # kill 3480097 00:14:54.841 15:02:35 -- common/autotest_common.sh@970 -- # wait 3480097 00:14:55.102 [2024-04-26 15:02:35.819114] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:55.102 15:02:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:55.102 15:02:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:55.102 00:14:55.102 real 0m19.381s 00:14:55.102 user 0m26.020s 00:14:55.102 sys 0m5.490s 00:14:55.102 15:02:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:55.102 15:02:35 -- common/autotest_common.sh@10 -- # set +x 00:14:55.102 ************************************ 00:14:55.102 END TEST nvmf_queue_depth 00:14:55.102 ************************************ 00:14:55.102 15:02:35 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:14:55.102 15:02:35 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:55.102 15:02:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:55.102 15:02:35 -- common/autotest_common.sh@10 -- # set +x 00:14:55.362 ************************************ 00:14:55.362 START TEST nvmf_multipath 00:14:55.362 ************************************ 00:14:55.362 15:02:36 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:14:55.362 * Looking for test storage... 00:14:55.362 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:55.362 15:02:36 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:55.362 15:02:36 -- nvmf/common.sh@7 -- # uname -s 00:14:55.362 15:02:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:55.362 15:02:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:55.362 15:02:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:55.362 15:02:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:55.362 15:02:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:55.362 15:02:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:55.362 15:02:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:55.362 15:02:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:55.362 15:02:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:55.362 15:02:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:55.362 15:02:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:55.362 15:02:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:14:55.362 15:02:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:55.362 15:02:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:55.362 15:02:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:55.362 15:02:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:55.362 15:02:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:55.362 15:02:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:55.362 15:02:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:55.362 15:02:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:55.362 15:02:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.362 15:02:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.362 15:02:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.362 15:02:36 -- paths/export.sh@5 -- # export PATH 00:14:55.362 15:02:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.362 15:02:36 -- nvmf/common.sh@47 -- # : 0 00:14:55.362 15:02:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:55.362 15:02:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:55.363 15:02:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:55.363 15:02:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:55.363 15:02:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:55.363 15:02:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:55.363 15:02:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:55.363 15:02:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:55.363 15:02:36 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:55.363 15:02:36 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:55.363 15:02:36 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:14:55.363 15:02:36 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:55.363 15:02:36 -- target/multipath.sh@43 -- # nvmftestinit 00:14:55.363 15:02:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:55.363 15:02:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:55.363 15:02:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:55.363 15:02:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:55.363 15:02:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:55.363 15:02:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.363 15:02:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.363 15:02:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.363 15:02:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:55.363 15:02:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:55.363 15:02:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:55.363 15:02:36 -- common/autotest_common.sh@10 -- # set +x 00:15:03.505 15:02:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:03.505 15:02:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:03.505 15:02:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:03.505 15:02:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:03.505 15:02:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:03.505 15:02:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:03.505 15:02:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:03.505 15:02:43 -- nvmf/common.sh@295 -- # net_devs=() 00:15:03.505 15:02:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:03.505 15:02:43 -- nvmf/common.sh@296 -- # e810=() 00:15:03.505 15:02:43 -- nvmf/common.sh@296 -- # local -ga e810 00:15:03.505 15:02:43 -- nvmf/common.sh@297 -- # x722=() 00:15:03.505 15:02:43 -- nvmf/common.sh@297 -- # local -ga x722 00:15:03.505 15:02:43 -- nvmf/common.sh@298 -- # mlx=() 00:15:03.505 15:02:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:03.505 15:02:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:03.505 15:02:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:15:03.505 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:15:03.505 15:02:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:03.505 15:02:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:15:03.505 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:15:03.505 15:02:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:03.505 15:02:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.505 15:02:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.505 15:02:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:15:03.505 Found net devices under 0000:31:00.0: mlx_0_0 00:15:03.505 15:02:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:03.505 15:02:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:03.505 15:02:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:15:03.505 Found net devices under 0000:31:00.1: mlx_0_1 00:15:03.505 15:02:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:03.505 15:02:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:03.505 15:02:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:03.505 15:02:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:03.505 15:02:43 -- nvmf/common.sh@58 -- # uname 00:15:03.505 15:02:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:03.505 15:02:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:03.505 15:02:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:03.505 15:02:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:03.505 15:02:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:03.505 15:02:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:03.505 15:02:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:03.505 15:02:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:03.505 15:02:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:03.505 15:02:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:03.505 15:02:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:03.505 15:02:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:03.505 15:02:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:03.505 15:02:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:03.505 15:02:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:03.505 15:02:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:03.505 15:02:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:03.505 15:02:43 -- nvmf/common.sh@105 -- # continue 2 00:15:03.505 15:02:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.505 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:03.505 15:02:43 -- nvmf/common.sh@105 -- # continue 2 00:15:03.505 15:02:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:03.505 15:02:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:03.505 15:02:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:03.505 15:02:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:03.505 15:02:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:03.505 15:02:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:03.505 15:02:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:03.505 15:02:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:03.505 15:02:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:03.505 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:03.505 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:15:03.505 altname enp49s0f0np0 00:15:03.505 altname ens786f0np0 00:15:03.505 inet 192.168.100.8/24 scope global mlx_0_0 00:15:03.506 valid_lft forever preferred_lft forever 00:15:03.506 15:02:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:03.506 15:02:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:03.506 15:02:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:03.506 15:02:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:03.506 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:03.506 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:15:03.506 altname enp49s0f1np1 00:15:03.506 altname ens786f1np1 00:15:03.506 inet 192.168.100.9/24 scope global mlx_0_1 00:15:03.506 valid_lft forever preferred_lft forever 00:15:03.506 15:02:43 -- nvmf/common.sh@411 -- # return 0 00:15:03.506 15:02:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:03.506 15:02:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:03.506 15:02:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:03.506 15:02:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:03.506 15:02:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:03.506 15:02:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:03.506 15:02:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:03.506 15:02:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:03.506 15:02:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:03.506 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.506 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:03.506 15:02:43 -- nvmf/common.sh@105 -- # continue 2 00:15:03.506 15:02:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:03.506 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.506 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:03.506 15:02:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@105 -- # continue 2 00:15:03.506 15:02:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:03.506 15:02:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:03.506 15:02:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:03.506 15:02:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:03.506 15:02:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:03.506 15:02:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:03.506 15:02:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:03.506 192.168.100.9' 00:15:03.506 15:02:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:03.506 192.168.100.9' 00:15:03.506 15:02:43 -- nvmf/common.sh@446 -- # head -n 1 00:15:03.506 15:02:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:03.506 15:02:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:03.506 192.168.100.9' 00:15:03.506 15:02:43 -- nvmf/common.sh@447 -- # tail -n +2 00:15:03.506 15:02:43 -- nvmf/common.sh@447 -- # head -n 1 00:15:03.506 15:02:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:03.506 15:02:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:03.506 15:02:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:03.506 15:02:43 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:15:03.506 15:02:43 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:15:03.506 15:02:43 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:15:03.506 run this test only with TCP transport for now 00:15:03.506 15:02:43 -- target/multipath.sh@53 -- # nvmftestfini 00:15:03.506 15:02:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:03.506 15:02:43 -- nvmf/common.sh@117 -- # sync 00:15:03.506 15:02:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@120 -- # set +e 00:15:03.506 15:02:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:03.506 15:02:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:03.506 rmmod nvme_rdma 00:15:03.506 rmmod nvme_fabrics 00:15:03.506 15:02:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:03.506 15:02:43 -- nvmf/common.sh@124 -- # set -e 00:15:03.506 15:02:43 -- nvmf/common.sh@125 -- # return 0 00:15:03.506 15:02:43 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:03.506 15:02:43 -- target/multipath.sh@54 -- # exit 0 00:15:03.506 15:02:43 -- target/multipath.sh@1 -- # nvmftestfini 00:15:03.506 15:02:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:03.506 15:02:43 -- nvmf/common.sh@117 -- # sync 00:15:03.506 15:02:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@120 -- # set +e 00:15:03.506 15:02:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:03.506 15:02:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:03.506 15:02:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:03.506 15:02:43 -- nvmf/common.sh@124 -- # set -e 00:15:03.506 15:02:43 -- nvmf/common.sh@125 -- # return 0 00:15:03.506 15:02:43 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:03.506 15:02:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:03.506 00:15:03.506 real 0m7.288s 00:15:03.506 user 0m2.086s 00:15:03.506 sys 0m5.288s 00:15:03.506 15:02:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:15:03.506 15:02:43 -- common/autotest_common.sh@10 -- # set +x 00:15:03.506 ************************************ 00:15:03.506 END TEST nvmf_multipath 00:15:03.506 ************************************ 00:15:03.506 15:02:43 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:15:03.506 15:02:43 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:15:03.506 15:02:43 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:15:03.506 15:02:43 -- common/autotest_common.sh@10 -- # set +x 00:15:03.506 ************************************ 00:15:03.506 START TEST nvmf_zcopy 00:15:03.506 ************************************ 00:15:03.506 15:02:43 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:15:03.506 * Looking for test storage... 00:15:03.506 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:03.506 15:02:43 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:03.506 15:02:43 -- nvmf/common.sh@7 -- # uname -s 00:15:03.506 15:02:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:03.506 15:02:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:03.506 15:02:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:03.506 15:02:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:03.506 15:02:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:03.506 15:02:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:03.506 15:02:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:03.506 15:02:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:03.506 15:02:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:03.506 15:02:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:03.506 15:02:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:03.506 15:02:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:03.506 15:02:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:03.506 15:02:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:03.506 15:02:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:03.506 15:02:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:03.506 15:02:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:03.506 15:02:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:03.506 15:02:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:03.506 15:02:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:03.506 15:02:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.506 15:02:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.506 15:02:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.506 15:02:43 -- paths/export.sh@5 -- # export PATH 00:15:03.507 15:02:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.507 15:02:43 -- nvmf/common.sh@47 -- # : 0 00:15:03.507 15:02:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:03.507 15:02:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:03.507 15:02:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:03.507 15:02:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:03.507 15:02:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:03.507 15:02:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:03.507 15:02:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:03.507 15:02:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:03.507 15:02:43 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:03.507 15:02:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:03.507 15:02:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:03.507 15:02:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:03.507 15:02:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:03.507 15:02:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:03.507 15:02:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:03.507 15:02:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:03.507 15:02:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:03.507 15:02:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:03.507 15:02:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:03.507 15:02:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:03.507 15:02:43 -- common/autotest_common.sh@10 -- # set +x 00:15:10.122 15:02:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:10.122 15:02:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:10.122 15:02:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:10.122 15:02:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:10.122 15:02:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:10.122 15:02:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:10.122 15:02:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:10.122 15:02:50 -- nvmf/common.sh@295 -- # net_devs=() 00:15:10.122 15:02:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:10.122 15:02:50 -- nvmf/common.sh@296 -- # e810=() 00:15:10.122 15:02:50 -- nvmf/common.sh@296 -- # local -ga e810 00:15:10.122 15:02:50 -- nvmf/common.sh@297 -- # x722=() 00:15:10.122 15:02:50 -- nvmf/common.sh@297 -- # local -ga x722 00:15:10.122 15:02:50 -- nvmf/common.sh@298 -- # mlx=() 00:15:10.122 15:02:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:10.122 15:02:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:10.122 15:02:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:10.122 15:02:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:10.122 15:02:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:10.122 15:02:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:10.122 15:02:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:10.122 15:02:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:10.122 15:02:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:10.122 15:02:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:10.122 15:02:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:15:10.122 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:15:10.122 15:02:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:10.122 15:02:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:10.122 15:02:50 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:10.122 15:02:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:10.122 15:02:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:10.122 15:02:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:15:10.122 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:15:10.123 15:02:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:10.123 15:02:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:10.123 15:02:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:10.123 15:02:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:15:10.123 Found net devices under 0000:31:00.0: mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:10.123 15:02:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:10.123 15:02:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:10.123 15:02:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:15:10.123 Found net devices under 0000:31:00.1: mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:10.123 15:02:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:10.123 15:02:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:10.123 15:02:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:10.123 15:02:50 -- nvmf/common.sh@58 -- # uname 00:15:10.123 15:02:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:10.123 15:02:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:10.123 15:02:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:10.123 15:02:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:10.123 15:02:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:10.123 15:02:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:10.123 15:02:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:10.123 15:02:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:10.123 15:02:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:10.123 15:02:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:10.123 15:02:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:10.123 15:02:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:10.123 15:02:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:10.123 15:02:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:10.123 15:02:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:10.123 15:02:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@105 -- # continue 2 00:15:10.123 15:02:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@105 -- # continue 2 00:15:10.123 15:02:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:10.123 15:02:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:10.123 15:02:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:10.123 15:02:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:10.123 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:10.123 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:15:10.123 altname enp49s0f0np0 00:15:10.123 altname ens786f0np0 00:15:10.123 inet 192.168.100.8/24 scope global mlx_0_0 00:15:10.123 valid_lft forever preferred_lft forever 00:15:10.123 15:02:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:10.123 15:02:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:10.123 15:02:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:10.123 15:02:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:10.123 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:10.123 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:15:10.123 altname enp49s0f1np1 00:15:10.123 altname ens786f1np1 00:15:10.123 inet 192.168.100.9/24 scope global mlx_0_1 00:15:10.123 valid_lft forever preferred_lft forever 00:15:10.123 15:02:50 -- nvmf/common.sh@411 -- # return 0 00:15:10.123 15:02:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:10.123 15:02:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:10.123 15:02:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:10.123 15:02:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:10.123 15:02:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:10.123 15:02:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:10.123 15:02:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:10.123 15:02:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:10.123 15:02:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:10.123 15:02:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@105 -- # continue 2 00:15:10.123 15:02:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:10.123 15:02:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:10.123 15:02:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@105 -- # continue 2 00:15:10.123 15:02:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:10.123 15:02:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:10.123 15:02:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:10.123 15:02:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:10.123 15:02:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:10.123 15:02:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:10.123 192.168.100.9' 00:15:10.123 15:02:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:10.123 192.168.100.9' 00:15:10.123 15:02:50 -- nvmf/common.sh@446 -- # head -n 1 00:15:10.123 15:02:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:10.123 15:02:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:10.123 192.168.100.9' 00:15:10.123 15:02:50 -- nvmf/common.sh@447 -- # tail -n +2 00:15:10.123 15:02:50 -- nvmf/common.sh@447 -- # head -n 1 00:15:10.123 15:02:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:10.123 15:02:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:10.123 15:02:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:10.123 15:02:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:10.123 15:02:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:10.123 15:02:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:10.123 15:02:50 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:10.123 15:02:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:10.123 15:02:50 -- common/autotest_common.sh@720 -- # xtrace_disable 00:15:10.123 15:02:50 -- common/autotest_common.sh@10 -- # set +x 00:15:10.123 15:02:50 -- nvmf/common.sh@470 -- # nvmfpid=3489946 00:15:10.123 15:02:50 -- nvmf/common.sh@471 -- # waitforlisten 3489946 00:15:10.123 15:02:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:10.123 15:02:50 -- common/autotest_common.sh@827 -- # '[' -z 3489946 ']' 00:15:10.123 15:02:50 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:10.123 15:02:50 -- common/autotest_common.sh@832 -- # local max_retries=100 00:15:10.123 15:02:50 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:10.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:10.123 15:02:50 -- common/autotest_common.sh@836 -- # xtrace_disable 00:15:10.123 15:02:50 -- common/autotest_common.sh@10 -- # set +x 00:15:10.123 [2024-04-26 15:02:50.761275] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:15:10.123 [2024-04-26 15:02:50.761334] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:10.123 EAL: No free 2048 kB hugepages reported on node 1 00:15:10.123 [2024-04-26 15:02:50.820835] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:10.123 [2024-04-26 15:02:50.883021] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:10.124 [2024-04-26 15:02:50.883055] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:10.124 [2024-04-26 15:02:50.883062] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:10.124 [2024-04-26 15:02:50.883069] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:10.124 [2024-04-26 15:02:50.883075] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:10.124 [2024-04-26 15:02:50.883101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:10.695 15:02:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:15:10.695 15:02:51 -- common/autotest_common.sh@860 -- # return 0 00:15:10.695 15:02:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:10.695 15:02:51 -- common/autotest_common.sh@726 -- # xtrace_disable 00:15:10.695 15:02:51 -- common/autotest_common.sh@10 -- # set +x 00:15:10.695 15:02:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:10.695 15:02:51 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:15:10.695 15:02:51 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:15:10.695 Unsupported transport: rdma 00:15:10.695 15:02:51 -- target/zcopy.sh@17 -- # exit 0 00:15:10.695 15:02:51 -- target/zcopy.sh@1 -- # process_shm --id 0 00:15:10.695 15:02:51 -- common/autotest_common.sh@804 -- # type=--id 00:15:10.695 15:02:51 -- common/autotest_common.sh@805 -- # id=0 00:15:10.695 15:02:51 -- common/autotest_common.sh@806 -- # '[' --id = --pid ']' 00:15:10.695 15:02:51 -- common/autotest_common.sh@810 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:10.695 15:02:51 -- common/autotest_common.sh@810 -- # shm_files=nvmf_trace.0 00:15:10.695 15:02:51 -- common/autotest_common.sh@812 -- # [[ -z nvmf_trace.0 ]] 00:15:10.695 15:02:51 -- common/autotest_common.sh@816 -- # for n in $shm_files 00:15:10.695 15:02:51 -- common/autotest_common.sh@817 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:10.695 nvmf_trace.0 00:15:10.695 15:02:51 -- common/autotest_common.sh@819 -- # return 0 00:15:10.695 15:02:51 -- target/zcopy.sh@1 -- # nvmftestfini 00:15:10.695 15:02:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:10.695 15:02:51 -- nvmf/common.sh@117 -- # sync 00:15:10.695 15:02:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:10.695 15:02:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:10.695 15:02:51 -- nvmf/common.sh@120 -- # set +e 00:15:10.695 15:02:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:10.695 15:02:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:10.695 rmmod nvme_rdma 00:15:10.695 rmmod nvme_fabrics 00:15:10.956 15:02:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:10.956 15:02:51 -- nvmf/common.sh@124 -- # set -e 00:15:10.956 15:02:51 -- nvmf/common.sh@125 -- # return 0 00:15:10.956 15:02:51 -- nvmf/common.sh@478 -- # '[' -n 3489946 ']' 00:15:10.956 15:02:51 -- nvmf/common.sh@479 -- # killprocess 3489946 00:15:10.956 15:02:51 -- common/autotest_common.sh@946 -- # '[' -z 3489946 ']' 00:15:10.956 15:02:51 -- common/autotest_common.sh@950 -- # kill -0 3489946 00:15:10.956 15:02:51 -- common/autotest_common.sh@951 -- # uname 00:15:10.956 15:02:51 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:15:10.956 15:02:51 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3489946 00:15:10.956 15:02:51 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:15:10.956 15:02:51 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:15:10.956 15:02:51 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3489946' 00:15:10.956 killing process with pid 3489946 00:15:10.956 15:02:51 -- common/autotest_common.sh@965 -- # kill 3489946 00:15:10.956 15:02:51 -- common/autotest_common.sh@970 -- # wait 3489946 00:15:10.956 15:02:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:10.956 15:02:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:10.956 00:15:10.956 real 0m8.244s 00:15:10.956 user 0m3.382s 00:15:10.956 sys 0m5.427s 00:15:10.956 15:02:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:15:10.956 15:02:51 -- common/autotest_common.sh@10 -- # set +x 00:15:10.956 ************************************ 00:15:10.956 END TEST nvmf_zcopy 00:15:10.956 ************************************ 00:15:10.956 15:02:51 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:15:10.956 15:02:51 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:15:10.956 15:02:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:15:10.956 15:02:51 -- common/autotest_common.sh@10 -- # set +x 00:15:11.217 ************************************ 00:15:11.217 START TEST nvmf_nmic 00:15:11.217 ************************************ 00:15:11.217 15:02:52 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:15:11.217 * Looking for test storage... 00:15:11.217 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:11.217 15:02:52 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:11.217 15:02:52 -- nvmf/common.sh@7 -- # uname -s 00:15:11.217 15:02:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:11.217 15:02:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:11.217 15:02:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:11.217 15:02:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:11.217 15:02:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:11.217 15:02:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:11.217 15:02:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:11.217 15:02:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:11.217 15:02:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:11.217 15:02:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:11.218 15:02:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:11.218 15:02:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:11.218 15:02:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:11.218 15:02:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:11.218 15:02:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:11.218 15:02:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:11.218 15:02:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:11.218 15:02:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:11.218 15:02:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:11.218 15:02:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:11.218 15:02:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.218 15:02:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.218 15:02:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.218 15:02:52 -- paths/export.sh@5 -- # export PATH 00:15:11.218 15:02:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:11.218 15:02:52 -- nvmf/common.sh@47 -- # : 0 00:15:11.218 15:02:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:11.218 15:02:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:11.218 15:02:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:11.218 15:02:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:11.218 15:02:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:11.218 15:02:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:11.218 15:02:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:11.218 15:02:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:11.218 15:02:52 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:11.218 15:02:52 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:11.218 15:02:52 -- target/nmic.sh@14 -- # nvmftestinit 00:15:11.218 15:02:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:11.218 15:02:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:11.218 15:02:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:11.218 15:02:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:11.218 15:02:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:11.218 15:02:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:11.218 15:02:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:11.218 15:02:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:11.479 15:02:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:11.479 15:02:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:11.479 15:02:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:11.479 15:02:52 -- common/autotest_common.sh@10 -- # set +x 00:15:18.102 15:02:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:18.102 15:02:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:18.102 15:02:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:18.102 15:02:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:18.102 15:02:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:18.102 15:02:58 -- nvmf/common.sh@295 -- # net_devs=() 00:15:18.102 15:02:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@296 -- # e810=() 00:15:18.102 15:02:58 -- nvmf/common.sh@296 -- # local -ga e810 00:15:18.102 15:02:58 -- nvmf/common.sh@297 -- # x722=() 00:15:18.102 15:02:58 -- nvmf/common.sh@297 -- # local -ga x722 00:15:18.102 15:02:58 -- nvmf/common.sh@298 -- # mlx=() 00:15:18.102 15:02:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:18.102 15:02:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:18.102 15:02:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:15:18.102 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:15:18.102 15:02:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:18.102 15:02:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:15:18.102 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:15:18.102 15:02:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:18.102 15:02:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.102 15:02:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.102 15:02:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:15:18.102 Found net devices under 0000:31:00.0: mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.102 15:02:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.102 15:02:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:15:18.102 Found net devices under 0000:31:00.1: mlx_0_1 00:15:18.102 15:02:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.102 15:02:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:18.102 15:02:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:18.102 15:02:58 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:18.102 15:02:58 -- nvmf/common.sh@58 -- # uname 00:15:18.102 15:02:58 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:18.102 15:02:58 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:18.102 15:02:58 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:18.102 15:02:58 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:18.102 15:02:58 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:18.102 15:02:58 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:18.102 15:02:58 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:18.102 15:02:58 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:18.102 15:02:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:18.102 15:02:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:18.102 15:02:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:18.102 15:02:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:18.102 15:02:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:18.102 15:02:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@105 -- # continue 2 00:15:18.102 15:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:18.102 15:02:58 -- nvmf/common.sh@105 -- # continue 2 00:15:18.102 15:02:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:18.102 15:02:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:18.102 15:02:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:18.102 15:02:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:18.102 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:18.102 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:15:18.102 altname enp49s0f0np0 00:15:18.102 altname ens786f0np0 00:15:18.102 inet 192.168.100.8/24 scope global mlx_0_0 00:15:18.102 valid_lft forever preferred_lft forever 00:15:18.102 15:02:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:18.102 15:02:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:18.102 15:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:18.102 15:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:18.102 15:02:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:18.102 15:02:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:18.102 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:18.102 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:15:18.102 altname enp49s0f1np1 00:15:18.102 altname ens786f1np1 00:15:18.102 inet 192.168.100.9/24 scope global mlx_0_1 00:15:18.102 valid_lft forever preferred_lft forever 00:15:18.102 15:02:58 -- nvmf/common.sh@411 -- # return 0 00:15:18.102 15:02:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:18.102 15:02:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:18.102 15:02:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:18.102 15:02:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:18.102 15:02:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:18.102 15:02:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:18.102 15:02:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:18.102 15:02:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:18.102 15:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:18.102 15:02:58 -- nvmf/common.sh@105 -- # continue 2 00:15:18.102 15:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.102 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:18.102 15:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:18.103 15:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:18.103 15:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:18.103 15:02:58 -- nvmf/common.sh@105 -- # continue 2 00:15:18.103 15:02:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:18.103 15:02:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:18.103 15:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:18.103 15:02:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:18.103 15:02:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:18.103 15:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:18.103 15:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:18.103 15:02:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:18.103 192.168.100.9' 00:15:18.103 15:02:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:18.103 192.168.100.9' 00:15:18.103 15:02:58 -- nvmf/common.sh@446 -- # head -n 1 00:15:18.103 15:02:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:18.103 15:02:58 -- nvmf/common.sh@447 -- # tail -n +2 00:15:18.103 15:02:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:18.103 192.168.100.9' 00:15:18.103 15:02:58 -- nvmf/common.sh@447 -- # head -n 1 00:15:18.103 15:02:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:18.103 15:02:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:18.103 15:02:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:18.103 15:02:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:18.103 15:02:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:18.103 15:02:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:18.103 15:02:59 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:18.103 15:02:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:18.103 15:02:59 -- common/autotest_common.sh@720 -- # xtrace_disable 00:15:18.103 15:02:59 -- common/autotest_common.sh@10 -- # set +x 00:15:18.103 15:02:59 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:18.103 15:02:59 -- nvmf/common.sh@470 -- # nvmfpid=3493952 00:15:18.103 15:02:59 -- nvmf/common.sh@471 -- # waitforlisten 3493952 00:15:18.103 15:02:59 -- common/autotest_common.sh@827 -- # '[' -z 3493952 ']' 00:15:18.103 15:02:59 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.103 15:02:59 -- common/autotest_common.sh@832 -- # local max_retries=100 00:15:18.103 15:02:59 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.103 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.103 15:02:59 -- common/autotest_common.sh@836 -- # xtrace_disable 00:15:18.103 15:02:59 -- common/autotest_common.sh@10 -- # set +x 00:15:18.364 [2024-04-26 15:02:59.095863] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:15:18.364 [2024-04-26 15:02:59.095941] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:18.364 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.364 [2024-04-26 15:02:59.161510] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:18.364 [2024-04-26 15:02:59.236452] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:18.364 [2024-04-26 15:02:59.236489] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:18.364 [2024-04-26 15:02:59.236498] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:18.364 [2024-04-26 15:02:59.236506] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:18.364 [2024-04-26 15:02:59.236513] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:18.364 [2024-04-26 15:02:59.236677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:18.364 [2024-04-26 15:02:59.236800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:18.364 [2024-04-26 15:02:59.236932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:18.364 [2024-04-26 15:02:59.236934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:18.935 15:02:59 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:15:18.935 15:02:59 -- common/autotest_common.sh@860 -- # return 0 00:15:18.935 15:02:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:18.935 15:02:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:15:18.935 15:02:59 -- common/autotest_common.sh@10 -- # set +x 00:15:19.196 15:02:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:19.196 15:02:59 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:19.196 15:02:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.196 15:02:59 -- common/autotest_common.sh@10 -- # set +x 00:15:19.196 [2024-04-26 15:02:59.960437] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xfe4b00/0xfe8ff0) succeed. 00:15:19.196 [2024-04-26 15:02:59.973709] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xfe6140/0x102a680) succeed. 00:15:19.196 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.196 15:03:00 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:19.196 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.196 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.196 Malloc0 00:15:19.196 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.196 15:03:00 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:19.196 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.196 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.196 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.196 15:03:00 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:19.196 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.196 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.196 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.196 15:03:00 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:19.196 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.196 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.457 [2024-04-26 15:03:00.146452] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:19.457 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.457 15:03:00 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:19.457 test case1: single bdev can't be used in multiple subsystems 00:15:19.457 15:03:00 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:19.457 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.457 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.457 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.457 15:03:00 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:15:19.457 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.457 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.457 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.457 15:03:00 -- target/nmic.sh@28 -- # nmic_status=0 00:15:19.457 15:03:00 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:19.457 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.457 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.457 [2024-04-26 15:03:00.182232] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:19.457 [2024-04-26 15:03:00.182249] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:19.457 [2024-04-26 15:03:00.182257] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:19.457 request: 00:15:19.457 { 00:15:19.457 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:19.457 "namespace": { 00:15:19.457 "bdev_name": "Malloc0", 00:15:19.457 "no_auto_visible": false 00:15:19.457 }, 00:15:19.457 "method": "nvmf_subsystem_add_ns", 00:15:19.457 "req_id": 1 00:15:19.457 } 00:15:19.457 Got JSON-RPC error response 00:15:19.457 response: 00:15:19.457 { 00:15:19.457 "code": -32602, 00:15:19.457 "message": "Invalid parameters" 00:15:19.457 } 00:15:19.457 15:03:00 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:15:19.457 15:03:00 -- target/nmic.sh@29 -- # nmic_status=1 00:15:19.457 15:03:00 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:19.457 15:03:00 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:19.457 Adding namespace failed - expected result. 00:15:19.457 15:03:00 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:19.457 test case2: host connect to nvmf target in multiple paths 00:15:19.457 15:03:00 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:15:19.457 15:03:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:19.457 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.457 [2024-04-26 15:03:00.194294] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:15:19.457 15:03:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:19.457 15:03:00 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:15:26.079 15:03:05 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:15:31.372 15:03:11 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:31.372 15:03:11 -- common/autotest_common.sh@1194 -- # local i=0 00:15:31.372 15:03:11 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:15:31.372 15:03:11 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:15:31.372 15:03:11 -- common/autotest_common.sh@1201 -- # sleep 2 00:15:32.796 15:03:13 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:15:32.796 15:03:13 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:15:32.796 15:03:13 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:15:32.796 15:03:13 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:15:32.796 15:03:13 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:15:32.796 15:03:13 -- common/autotest_common.sh@1204 -- # return 0 00:15:32.796 15:03:13 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:32.796 [global] 00:15:32.796 thread=1 00:15:32.796 invalidate=1 00:15:32.796 rw=write 00:15:32.796 time_based=1 00:15:32.796 runtime=1 00:15:32.796 ioengine=libaio 00:15:32.796 direct=1 00:15:32.796 bs=4096 00:15:32.796 iodepth=1 00:15:32.796 norandommap=0 00:15:32.796 numjobs=1 00:15:32.796 00:15:32.796 verify_dump=1 00:15:32.796 verify_backlog=512 00:15:32.796 verify_state_save=0 00:15:32.796 do_verify=1 00:15:32.796 verify=crc32c-intel 00:15:32.796 [job0] 00:15:32.796 filename=/dev/nvme0n1 00:15:32.796 Could not set queue depth (nvme0n1) 00:15:33.063 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:33.063 fio-3.35 00:15:33.063 Starting 1 thread 00:15:34.449 00:15:34.449 job0: (groupid=0, jobs=1): err= 0: pid=3497536: Fri Apr 26 15:03:14 2024 00:15:34.449 read: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec) 00:15:34.449 slat (nsec): min=5380, max=27930, avg=5936.44, stdev=724.20 00:15:34.449 clat (nsec): min=49651, max=85169, avg=64493.87, stdev=4689.72 00:15:34.449 lat (nsec): min=59939, max=95064, avg=70430.31, stdev=4715.48 00:15:34.449 clat percentiles (nsec): 00:15:34.449 | 1.00th=[56064], 5.00th=[57088], 10.00th=[58624], 20.00th=[60160], 00:15:34.449 | 30.00th=[61696], 40.00th=[62720], 50.00th=[64256], 60.00th=[65280], 00:15:34.449 | 70.00th=[67072], 80.00th=[68096], 90.00th=[71168], 95.00th=[73216], 00:15:34.449 | 99.00th=[76288], 99.50th=[77312], 99.90th=[81408], 99.95th=[82432], 00:15:34.449 | 99.99th=[85504] 00:15:34.449 write: IOPS=7075, BW=27.6MiB/s (29.0MB/s)(27.7MiB/1001msec); 0 zone resets 00:15:34.449 slat (nsec): min=7859, max=42959, avg=8755.11, stdev=1402.60 00:15:34.449 clat (usec): min=46, max=244, avg=62.02, stdev= 8.21 00:15:34.449 lat (usec): min=59, max=274, avg=70.78, stdev= 9.02 00:15:34.449 clat percentiles (usec): 00:15:34.449 | 1.00th=[ 53], 5.00th=[ 55], 10.00th=[ 57], 20.00th=[ 58], 00:15:34.449 | 30.00th=[ 60], 40.00th=[ 61], 50.00th=[ 62], 60.00th=[ 63], 00:15:34.449 | 70.00th=[ 64], 80.00th=[ 67], 90.00th=[ 69], 95.00th=[ 71], 00:15:34.449 | 99.00th=[ 75], 99.50th=[ 77], 99.90th=[ 206], 99.95th=[ 217], 00:15:34.449 | 99.99th=[ 245] 00:15:34.449 bw ( KiB/s): min=28672, max=28672, per=100.00%, avg=28672.00, stdev= 0.00, samples=1 00:15:34.449 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:15:34.449 lat (usec) : 50=0.03%, 100=99.85%, 250=0.12% 00:15:34.449 cpu : usr=7.90%, sys=9.80%, ctx=13739, majf=0, minf=1 00:15:34.449 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:34.449 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.449 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:34.449 issued rwts: total=6656,7083,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:34.449 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:34.449 00:15:34.449 Run status group 0 (all jobs): 00:15:34.449 READ: bw=26.0MiB/s (27.2MB/s), 26.0MiB/s-26.0MiB/s (27.2MB/s-27.2MB/s), io=26.0MiB (27.3MB), run=1001-1001msec 00:15:34.449 WRITE: bw=27.6MiB/s (29.0MB/s), 27.6MiB/s-27.6MiB/s (29.0MB/s-29.0MB/s), io=27.7MiB (29.0MB), run=1001-1001msec 00:15:34.449 00:15:34.449 Disk stats (read/write): 00:15:34.449 nvme0n1: ios=6194/6212, merge=0/0, ticks=382/364, in_queue=746, util=90.98% 00:15:34.449 15:03:14 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:42.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:42.591 15:03:23 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:42.591 15:03:23 -- common/autotest_common.sh@1215 -- # local i=0 00:15:42.591 15:03:23 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:15:42.591 15:03:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:42.591 15:03:23 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:15:42.591 15:03:23 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:42.591 15:03:23 -- common/autotest_common.sh@1227 -- # return 0 00:15:42.591 15:03:23 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:42.591 15:03:23 -- target/nmic.sh@53 -- # nvmftestfini 00:15:42.591 15:03:23 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:42.591 15:03:23 -- nvmf/common.sh@117 -- # sync 00:15:42.591 15:03:23 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:42.591 15:03:23 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:42.591 15:03:23 -- nvmf/common.sh@120 -- # set +e 00:15:42.591 15:03:23 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:42.591 15:03:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:42.591 rmmod nvme_rdma 00:15:42.591 rmmod nvme_fabrics 00:15:42.591 15:03:23 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:42.591 15:03:23 -- nvmf/common.sh@124 -- # set -e 00:15:42.591 15:03:23 -- nvmf/common.sh@125 -- # return 0 00:15:42.591 15:03:23 -- nvmf/common.sh@478 -- # '[' -n 3493952 ']' 00:15:42.591 15:03:23 -- nvmf/common.sh@479 -- # killprocess 3493952 00:15:42.591 15:03:23 -- common/autotest_common.sh@946 -- # '[' -z 3493952 ']' 00:15:42.591 15:03:23 -- common/autotest_common.sh@950 -- # kill -0 3493952 00:15:42.591 15:03:23 -- common/autotest_common.sh@951 -- # uname 00:15:42.591 15:03:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:15:42.591 15:03:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3493952 00:15:42.591 15:03:23 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:15:42.591 15:03:23 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:15:42.591 15:03:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3493952' 00:15:42.591 killing process with pid 3493952 00:15:42.591 15:03:23 -- common/autotest_common.sh@965 -- # kill 3493952 00:15:42.591 15:03:23 -- common/autotest_common.sh@970 -- # wait 3493952 00:15:42.591 [2024-04-26 15:03:23.311975] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:42.591 15:03:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:42.591 15:03:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:42.591 00:15:42.591 real 0m31.429s 00:15:42.591 user 1m53.125s 00:15:42.591 sys 0m6.159s 00:15:42.591 15:03:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:15:42.591 15:03:23 -- common/autotest_common.sh@10 -- # set +x 00:15:42.591 ************************************ 00:15:42.591 END TEST nvmf_nmic 00:15:42.591 ************************************ 00:15:42.591 15:03:23 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:15:42.591 15:03:23 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:15:42.591 15:03:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:15:42.591 15:03:23 -- common/autotest_common.sh@10 -- # set +x 00:15:42.852 ************************************ 00:15:42.852 START TEST nvmf_fio_target 00:15:42.852 ************************************ 00:15:42.852 15:03:23 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:15:42.852 * Looking for test storage... 00:15:42.852 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:42.852 15:03:23 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:42.852 15:03:23 -- nvmf/common.sh@7 -- # uname -s 00:15:42.852 15:03:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:42.852 15:03:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:42.852 15:03:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:42.852 15:03:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:42.852 15:03:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:42.852 15:03:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:42.852 15:03:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:42.852 15:03:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:42.852 15:03:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:42.852 15:03:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:42.852 15:03:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:42.852 15:03:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:15:42.852 15:03:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:42.852 15:03:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:42.852 15:03:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:42.852 15:03:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:42.852 15:03:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:42.852 15:03:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:42.852 15:03:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:42.852 15:03:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:42.852 15:03:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.852 15:03:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.852 15:03:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.852 15:03:23 -- paths/export.sh@5 -- # export PATH 00:15:42.853 15:03:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.853 15:03:23 -- nvmf/common.sh@47 -- # : 0 00:15:42.853 15:03:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:42.853 15:03:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:42.853 15:03:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:42.853 15:03:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:42.853 15:03:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:42.853 15:03:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:42.853 15:03:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:42.853 15:03:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:42.853 15:03:23 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:42.853 15:03:23 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:42.853 15:03:23 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:42.853 15:03:23 -- target/fio.sh@16 -- # nvmftestinit 00:15:42.853 15:03:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:42.853 15:03:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:42.853 15:03:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:42.853 15:03:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:42.853 15:03:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:42.853 15:03:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.853 15:03:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.853 15:03:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.853 15:03:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:42.853 15:03:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:42.853 15:03:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:42.853 15:03:23 -- common/autotest_common.sh@10 -- # set +x 00:15:50.998 15:03:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:50.998 15:03:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:50.998 15:03:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:50.998 15:03:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:50.998 15:03:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:50.998 15:03:30 -- nvmf/common.sh@295 -- # net_devs=() 00:15:50.998 15:03:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@296 -- # e810=() 00:15:50.998 15:03:30 -- nvmf/common.sh@296 -- # local -ga e810 00:15:50.998 15:03:30 -- nvmf/common.sh@297 -- # x722=() 00:15:50.998 15:03:30 -- nvmf/common.sh@297 -- # local -ga x722 00:15:50.998 15:03:30 -- nvmf/common.sh@298 -- # mlx=() 00:15:50.998 15:03:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:50.998 15:03:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:50.998 15:03:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:15:50.998 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:15:50.998 15:03:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:50.998 15:03:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:15:50.998 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:15:50.998 15:03:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:50.998 15:03:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:50.998 15:03:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:50.998 15:03:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:15:50.998 Found net devices under 0000:31:00.0: mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:50.998 15:03:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:50.998 15:03:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:15:50.998 Found net devices under 0000:31:00.1: mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:50.998 15:03:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:50.998 15:03:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:50.998 15:03:30 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:50.998 15:03:30 -- nvmf/common.sh@58 -- # uname 00:15:50.998 15:03:30 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:50.998 15:03:30 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:50.998 15:03:30 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:50.998 15:03:30 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:50.998 15:03:30 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:50.998 15:03:30 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:50.998 15:03:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:50.998 15:03:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:50.998 15:03:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:50.998 15:03:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:50.998 15:03:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:50.998 15:03:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:50.998 15:03:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:50.998 15:03:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@105 -- # continue 2 00:15:50.998 15:03:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@105 -- # continue 2 00:15:50.998 15:03:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:50.998 15:03:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:50.998 15:03:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:50.998 15:03:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:50.998 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:50.998 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:15:50.998 altname enp49s0f0np0 00:15:50.998 altname ens786f0np0 00:15:50.998 inet 192.168.100.8/24 scope global mlx_0_0 00:15:50.998 valid_lft forever preferred_lft forever 00:15:50.998 15:03:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:50.998 15:03:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:50.998 15:03:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:50.998 15:03:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:50.998 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:50.998 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:15:50.998 altname enp49s0f1np1 00:15:50.998 altname ens786f1np1 00:15:50.998 inet 192.168.100.9/24 scope global mlx_0_1 00:15:50.998 valid_lft forever preferred_lft forever 00:15:50.998 15:03:30 -- nvmf/common.sh@411 -- # return 0 00:15:50.998 15:03:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:50.998 15:03:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:50.998 15:03:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:50.998 15:03:30 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:50.998 15:03:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:50.998 15:03:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:50.998 15:03:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:50.998 15:03:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:50.998 15:03:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@105 -- # continue 2 00:15:50.998 15:03:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:50.998 15:03:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:50.998 15:03:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@105 -- # continue 2 00:15:50.998 15:03:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:50.998 15:03:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:50.998 15:03:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:50.998 15:03:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:50.998 15:03:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:50.998 15:03:30 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:50.998 192.168.100.9' 00:15:50.998 15:03:30 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:50.998 192.168.100.9' 00:15:50.998 15:03:30 -- nvmf/common.sh@446 -- # head -n 1 00:15:50.998 15:03:30 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:50.998 15:03:30 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:50.998 192.168.100.9' 00:15:50.998 15:03:30 -- nvmf/common.sh@447 -- # tail -n +2 00:15:50.998 15:03:30 -- nvmf/common.sh@447 -- # head -n 1 00:15:50.998 15:03:30 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:50.998 15:03:30 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:50.998 15:03:30 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:50.998 15:03:30 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:50.998 15:03:30 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:50.998 15:03:30 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:50.998 15:03:30 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:15:50.998 15:03:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:50.998 15:03:30 -- common/autotest_common.sh@720 -- # xtrace_disable 00:15:50.998 15:03:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.998 15:03:30 -- nvmf/common.sh@470 -- # nvmfpid=3503121 00:15:50.998 15:03:30 -- nvmf/common.sh@471 -- # waitforlisten 3503121 00:15:50.998 15:03:30 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:50.998 15:03:30 -- common/autotest_common.sh@827 -- # '[' -z 3503121 ']' 00:15:50.999 15:03:30 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:50.999 15:03:30 -- common/autotest_common.sh@832 -- # local max_retries=100 00:15:50.999 15:03:30 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:50.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:50.999 15:03:30 -- common/autotest_common.sh@836 -- # xtrace_disable 00:15:50.999 15:03:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.999 [2024-04-26 15:03:30.823404] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:15:50.999 [2024-04-26 15:03:30.823470] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:50.999 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.999 [2024-04-26 15:03:30.888962] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:50.999 [2024-04-26 15:03:30.962232] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:50.999 [2024-04-26 15:03:30.962282] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:50.999 [2024-04-26 15:03:30.962291] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:50.999 [2024-04-26 15:03:30.962299] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:50.999 [2024-04-26 15:03:30.962306] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:50.999 [2024-04-26 15:03:30.962475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.999 [2024-04-26 15:03:30.962656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:50.999 [2024-04-26 15:03:30.962783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:50.999 [2024-04-26 15:03:30.962787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:50.999 15:03:31 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:15:50.999 15:03:31 -- common/autotest_common.sh@860 -- # return 0 00:15:50.999 15:03:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:50.999 15:03:31 -- common/autotest_common.sh@726 -- # xtrace_disable 00:15:50.999 15:03:31 -- common/autotest_common.sh@10 -- # set +x 00:15:50.999 15:03:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:50.999 15:03:31 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:50.999 [2024-04-26 15:03:31.825323] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x153bb00/0x153fff0) succeed. 00:15:50.999 [2024-04-26 15:03:31.838302] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x153d140/0x1581680) succeed. 00:15:51.260 15:03:31 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.260 15:03:32 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:15:51.260 15:03:32 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.522 15:03:32 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:15:51.522 15:03:32 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.784 15:03:32 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:15:51.784 15:03:32 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:51.784 15:03:32 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:15:51.784 15:03:32 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:15:52.046 15:03:32 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:52.307 15:03:33 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:15:52.307 15:03:33 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:52.307 15:03:33 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:15:52.307 15:03:33 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:52.567 15:03:33 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:15:52.567 15:03:33 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:15:52.827 15:03:33 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:52.827 15:03:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:52.827 15:03:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:53.087 15:03:33 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:15:53.087 15:03:33 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:53.347 15:03:34 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:53.347 [2024-04-26 15:03:34.225138] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:53.347 15:03:34 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:15:53.608 15:03:34 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:15:53.869 15:03:34 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:16:00.457 15:03:40 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:00.457 15:03:40 -- common/autotest_common.sh@1194 -- # local i=0 00:16:00.457 15:03:40 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:16:00.457 15:03:40 -- common/autotest_common.sh@1196 -- # [[ -n 4 ]] 00:16:00.457 15:03:40 -- common/autotest_common.sh@1197 -- # nvme_device_counter=4 00:16:00.457 15:03:40 -- common/autotest_common.sh@1201 -- # sleep 2 00:16:01.402 15:03:42 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:16:01.402 15:03:42 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:16:01.402 15:03:42 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:16:01.402 15:03:42 -- common/autotest_common.sh@1203 -- # nvme_devices=4 00:16:01.402 15:03:42 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:16:01.402 15:03:42 -- common/autotest_common.sh@1204 -- # return 0 00:16:01.402 15:03:42 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:01.664 [global] 00:16:01.664 thread=1 00:16:01.664 invalidate=1 00:16:01.664 rw=write 00:16:01.664 time_based=1 00:16:01.664 runtime=1 00:16:01.664 ioengine=libaio 00:16:01.664 direct=1 00:16:01.664 bs=4096 00:16:01.664 iodepth=1 00:16:01.664 norandommap=0 00:16:01.664 numjobs=1 00:16:01.664 00:16:01.664 verify_dump=1 00:16:01.664 verify_backlog=512 00:16:01.664 verify_state_save=0 00:16:01.664 do_verify=1 00:16:01.664 verify=crc32c-intel 00:16:01.664 [job0] 00:16:01.664 filename=/dev/nvme0n1 00:16:01.664 [job1] 00:16:01.664 filename=/dev/nvme0n2 00:16:01.664 [job2] 00:16:01.664 filename=/dev/nvme0n3 00:16:01.664 [job3] 00:16:01.664 filename=/dev/nvme0n4 00:16:01.664 Could not set queue depth (nvme0n1) 00:16:01.664 Could not set queue depth (nvme0n2) 00:16:01.664 Could not set queue depth (nvme0n3) 00:16:01.664 Could not set queue depth (nvme0n4) 00:16:01.924 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:01.924 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:01.924 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:01.924 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:01.924 fio-3.35 00:16:01.924 Starting 4 threads 00:16:03.347 00:16:03.347 job0: (groupid=0, jobs=1): err= 0: pid=3505721: Fri Apr 26 15:03:43 2024 00:16:03.347 read: IOPS=6250, BW=24.4MiB/s (25.6MB/s)(24.4MiB/1001msec) 00:16:03.347 slat (nsec): min=5347, max=41929, avg=6468.22, stdev=2795.82 00:16:03.347 clat (usec): min=33, max=302, avg=69.18, stdev=25.55 00:16:03.347 lat (usec): min=48, max=329, avg=75.64, stdev=27.55 00:16:03.347 clat percentiles (usec): 00:16:03.347 | 1.00th=[ 46], 5.00th=[ 49], 10.00th=[ 50], 20.00th=[ 53], 00:16:03.347 | 30.00th=[ 56], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 73], 00:16:03.347 | 70.00th=[ 76], 80.00th=[ 78], 90.00th=[ 82], 95.00th=[ 85], 00:16:03.347 | 99.00th=[ 237], 99.50th=[ 253], 99.90th=[ 285], 99.95th=[ 289], 00:16:03.347 | 99.99th=[ 302] 00:16:03.347 write: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec); 0 zone resets 00:16:03.348 slat (nsec): min=7943, max=50572, avg=9147.87, stdev=2465.88 00:16:03.348 clat (usec): min=36, max=311, avg=65.62, stdev=21.87 00:16:03.348 lat (usec): min=49, max=342, avg=74.77, stdev=23.53 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 45], 5.00th=[ 47], 10.00th=[ 49], 20.00th=[ 51], 00:16:03.348 | 30.00th=[ 55], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 70], 00:16:03.348 | 70.00th=[ 73], 80.00th=[ 75], 90.00th=[ 79], 95.00th=[ 82], 00:16:03.348 | 99.00th=[ 200], 99.50th=[ 251], 99.90th=[ 281], 99.95th=[ 289], 00:16:03.348 | 99.99th=[ 314] 00:16:03.348 bw ( KiB/s): min=28672, max=28672, per=40.99%, avg=28672.00, stdev= 0.00, samples=1 00:16:03.348 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:16:03.348 lat (usec) : 50=13.10%, 100=85.50%, 250=0.85%, 500=0.56% 00:16:03.348 cpu : usr=7.40%, sys=10.20%, ctx=12913, majf=0, minf=1 00:16:03.348 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:03.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 issued rwts: total=6257,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:03.348 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:03.348 job1: (groupid=0, jobs=1): err= 0: pid=3505722: Fri Apr 26 15:03:43 2024 00:16:03.348 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:03.348 slat (nsec): min=5373, max=46677, avg=18356.72, stdev=10115.47 00:16:03.348 clat (usec): min=64, max=484, avg=215.76, stdev=71.80 00:16:03.348 lat (usec): min=70, max=497, avg=234.11, stdev=73.60 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 76], 5.00th=[ 104], 10.00th=[ 109], 20.00th=[ 149], 00:16:03.348 | 30.00th=[ 182], 40.00th=[ 204], 50.00th=[ 217], 60.00th=[ 239], 00:16:03.348 | 70.00th=[ 251], 80.00th=[ 273], 90.00th=[ 306], 95.00th=[ 343], 00:16:03.348 | 99.00th=[ 396], 99.50th=[ 412], 99.90th=[ 465], 99.95th=[ 474], 00:16:03.348 | 99.99th=[ 486] 00:16:03.348 write: IOPS=2140, BW=8563KiB/s (8769kB/s)(8572KiB/1001msec); 0 zone resets 00:16:03.348 slat (nsec): min=7964, max=58001, avg=20931.70, stdev=11174.72 00:16:03.348 clat (usec): min=60, max=487, avg=210.62, stdev=71.00 00:16:03.348 lat (usec): min=69, max=517, avg=231.55, stdev=73.88 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 100], 5.00th=[ 105], 10.00th=[ 115], 20.00th=[ 149], 00:16:03.348 | 30.00th=[ 153], 40.00th=[ 184], 50.00th=[ 208], 60.00th=[ 237], 00:16:03.348 | 70.00th=[ 251], 80.00th=[ 269], 90.00th=[ 297], 95.00th=[ 330], 00:16:03.348 | 99.00th=[ 396], 99.50th=[ 420], 99.90th=[ 457], 99.95th=[ 474], 00:16:03.348 | 99.99th=[ 486] 00:16:03.348 bw ( KiB/s): min= 8192, max= 8192, per=11.71%, avg=8192.00, stdev= 0.00, samples=1 00:16:03.348 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:03.348 lat (usec) : 100=1.69%, 250=67.41%, 500=30.90% 00:16:03.348 cpu : usr=4.30%, sys=8.70%, ctx=4192, majf=0, minf=1 00:16:03.348 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:03.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 issued rwts: total=2048,2143,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:03.348 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:03.348 job2: (groupid=0, jobs=1): err= 0: pid=3505723: Fri Apr 26 15:03:43 2024 00:16:03.348 read: IOPS=4834, BW=18.9MiB/s (19.8MB/s)(18.9MiB/1001msec) 00:16:03.348 slat (nsec): min=5550, max=44098, avg=7711.42, stdev=5237.16 00:16:03.348 clat (usec): min=50, max=328, avg=88.68, stdev=45.75 00:16:03.348 lat (usec): min=57, max=365, avg=96.39, stdev=49.75 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 55], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 70], 00:16:03.348 | 30.00th=[ 73], 40.00th=[ 74], 50.00th=[ 76], 60.00th=[ 78], 00:16:03.348 | 70.00th=[ 80], 80.00th=[ 84], 90.00th=[ 118], 95.00th=[ 231], 00:16:03.348 | 99.00th=[ 281], 99.50th=[ 297], 99.90th=[ 322], 99.95th=[ 322], 00:16:03.348 | 99.99th=[ 330] 00:16:03.348 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:16:03.348 slat (nsec): min=8057, max=47296, avg=10712.29, stdev=5889.28 00:16:03.348 clat (usec): min=38, max=332, avg=88.42, stdev=49.32 00:16:03.348 lat (usec): min=57, max=357, avg=99.14, stdev=53.91 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 54], 5.00th=[ 62], 10.00th=[ 65], 20.00th=[ 68], 00:16:03.348 | 30.00th=[ 70], 40.00th=[ 72], 50.00th=[ 73], 60.00th=[ 75], 00:16:03.348 | 70.00th=[ 78], 80.00th=[ 82], 90.00th=[ 126], 95.00th=[ 239], 00:16:03.348 | 99.00th=[ 285], 99.50th=[ 297], 99.90th=[ 318], 99.95th=[ 322], 00:16:03.348 | 99.99th=[ 334] 00:16:03.348 bw ( KiB/s): min=16480, max=16480, per=23.56%, avg=16480.00, stdev= 0.00, samples=1 00:16:03.348 iops : min= 4120, max= 4120, avg=4120.00, stdev= 0.00, samples=1 00:16:03.348 lat (usec) : 50=0.07%, 100=86.69%, 250=9.63%, 500=3.61% 00:16:03.348 cpu : usr=5.50%, sys=10.10%, ctx=9959, majf=0, minf=1 00:16:03.348 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:03.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 issued rwts: total=4839,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:03.348 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:03.348 job3: (groupid=0, jobs=1): err= 0: pid=3505724: Fri Apr 26 15:03:43 2024 00:16:03.348 read: IOPS=3473, BW=13.6MiB/s (14.2MB/s)(13.6MiB/1001msec) 00:16:03.348 slat (nsec): min=5466, max=59996, avg=11543.55, stdev=9017.55 00:16:03.348 clat (usec): min=64, max=359, avg=131.88, stdev=69.64 00:16:03.348 lat (usec): min=71, max=397, avg=143.43, stdev=76.40 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 69], 5.00th=[ 73], 10.00th=[ 75], 20.00th=[ 79], 00:16:03.348 | 30.00th=[ 83], 40.00th=[ 93], 50.00th=[ 100], 60.00th=[ 108], 00:16:03.348 | 70.00th=[ 128], 80.00th=[ 215], 90.00th=[ 249], 95.00th=[ 269], 00:16:03.348 | 99.00th=[ 302], 99.50th=[ 318], 99.90th=[ 343], 99.95th=[ 355], 00:16:03.348 | 99.99th=[ 359] 00:16:03.348 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:16:03.348 slat (nsec): min=8061, max=51006, avg=13404.06, stdev=9058.99 00:16:03.348 clat (usec): min=58, max=379, avg=119.21, stdev=66.09 00:16:03.348 lat (usec): min=70, max=428, avg=132.61, stdev=73.00 00:16:03.348 clat percentiles (usec): 00:16:03.348 | 1.00th=[ 66], 5.00th=[ 69], 10.00th=[ 71], 20.00th=[ 75], 00:16:03.348 | 30.00th=[ 78], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 99], 00:16:03.348 | 70.00th=[ 109], 80.00th=[ 159], 90.00th=[ 247], 95.00th=[ 265], 00:16:03.348 | 99.00th=[ 297], 99.50th=[ 306], 99.90th=[ 330], 99.95th=[ 359], 00:16:03.348 | 99.99th=[ 379] 00:16:03.348 bw ( KiB/s): min=14024, max=14024, per=20.05%, avg=14024.00, stdev= 0.00, samples=1 00:16:03.348 iops : min= 3506, max= 3506, avg=3506.00, stdev= 0.00, samples=1 00:16:03.348 lat (usec) : 100=56.10%, 250=34.51%, 500=9.39% 00:16:03.348 cpu : usr=6.10%, sys=8.30%, ctx=7061, majf=0, minf=1 00:16:03.348 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:03.348 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:03.348 issued rwts: total=3477,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:03.348 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:03.348 00:16:03.348 Run status group 0 (all jobs): 00:16:03.348 READ: bw=64.9MiB/s (68.0MB/s), 8184KiB/s-24.4MiB/s (8380kB/s-25.6MB/s), io=64.9MiB (68.1MB), run=1001-1001msec 00:16:03.348 WRITE: bw=68.3MiB/s (71.6MB/s), 8563KiB/s-26.0MiB/s (8769kB/s-27.2MB/s), io=68.4MiB (71.7MB), run=1001-1001msec 00:16:03.348 00:16:03.348 Disk stats (read/write): 00:16:03.348 nvme0n1: ios=5492/5632, merge=0/0, ticks=362/341, in_queue=703, util=85.77% 00:16:03.348 nvme0n2: ios=1536/1983, merge=0/0, ticks=333/399, in_queue=732, util=86.27% 00:16:03.348 nvme0n3: ios=4093/4096, merge=0/0, ticks=350/366, in_queue=716, util=88.70% 00:16:03.348 nvme0n4: ios=2873/3072, merge=0/0, ticks=355/353, in_queue=708, util=89.64% 00:16:03.348 15:03:43 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:03.348 [global] 00:16:03.348 thread=1 00:16:03.348 invalidate=1 00:16:03.348 rw=randwrite 00:16:03.348 time_based=1 00:16:03.348 runtime=1 00:16:03.348 ioengine=libaio 00:16:03.348 direct=1 00:16:03.348 bs=4096 00:16:03.348 iodepth=1 00:16:03.348 norandommap=0 00:16:03.348 numjobs=1 00:16:03.348 00:16:03.348 verify_dump=1 00:16:03.348 verify_backlog=512 00:16:03.348 verify_state_save=0 00:16:03.348 do_verify=1 00:16:03.348 verify=crc32c-intel 00:16:03.348 [job0] 00:16:03.348 filename=/dev/nvme0n1 00:16:03.348 [job1] 00:16:03.348 filename=/dev/nvme0n2 00:16:03.348 [job2] 00:16:03.348 filename=/dev/nvme0n3 00:16:03.348 [job3] 00:16:03.348 filename=/dev/nvme0n4 00:16:03.348 Could not set queue depth (nvme0n1) 00:16:03.348 Could not set queue depth (nvme0n2) 00:16:03.348 Could not set queue depth (nvme0n3) 00:16:03.348 Could not set queue depth (nvme0n4) 00:16:03.616 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:03.616 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:03.616 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:03.616 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:03.616 fio-3.35 00:16:03.616 Starting 4 threads 00:16:05.031 00:16:05.031 job0: (groupid=0, jobs=1): err= 0: pid=3506247: Fri Apr 26 15:03:45 2024 00:16:05.031 read: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1001msec) 00:16:05.031 slat (nsec): min=5391, max=45046, avg=6325.30, stdev=2344.12 00:16:05.031 clat (usec): min=43, max=307, avg=72.31, stdev=19.22 00:16:05.031 lat (usec): min=49, max=334, avg=78.63, stdev=20.96 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 63], 20.00th=[ 67], 00:16:05.031 | 30.00th=[ 69], 40.00th=[ 70], 50.00th=[ 71], 60.00th=[ 73], 00:16:05.031 | 70.00th=[ 75], 80.00th=[ 77], 90.00th=[ 80], 95.00th=[ 83], 00:16:05.031 | 99.00th=[ 208], 99.50th=[ 243], 99.90th=[ 289], 99.95th=[ 293], 00:16:05.031 | 99.99th=[ 310] 00:16:05.031 write: IOPS=6367, BW=24.9MiB/s (26.1MB/s)(24.9MiB/1001msec); 0 zone resets 00:16:05.031 slat (nsec): min=7838, max=41808, avg=8890.54, stdev=1878.30 00:16:05.031 clat (usec): min=42, max=293, avg=67.92, stdev=14.12 00:16:05.031 lat (usec): min=51, max=322, avg=76.81, stdev=15.26 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 60], 20.00th=[ 63], 00:16:05.031 | 30.00th=[ 64], 40.00th=[ 66], 50.00th=[ 68], 60.00th=[ 69], 00:16:05.031 | 70.00th=[ 71], 80.00th=[ 73], 90.00th=[ 76], 95.00th=[ 79], 00:16:05.031 | 99.00th=[ 86], 99.50th=[ 204], 99.90th=[ 258], 99.95th=[ 281], 00:16:05.031 | 99.99th=[ 293] 00:16:05.031 bw ( KiB/s): min=24576, max=24576, per=31.64%, avg=24576.00, stdev= 0.00, samples=1 00:16:05.031 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=1 00:16:05.031 lat (usec) : 50=1.15%, 100=98.01%, 250=0.62%, 500=0.22% 00:16:05.031 cpu : usr=6.00%, sys=10.70%, ctx=12518, majf=0, minf=1 00:16:05.031 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:05.031 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.031 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.031 issued rwts: total=6144,6374,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:05.031 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:05.031 job1: (groupid=0, jobs=1): err= 0: pid=3506248: Fri Apr 26 15:03:45 2024 00:16:05.031 read: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1001msec) 00:16:05.031 slat (nsec): min=5289, max=40586, avg=6359.21, stdev=2335.83 00:16:05.031 clat (usec): min=45, max=332, avg=72.41, stdev=19.42 00:16:05.031 lat (usec): min=51, max=363, avg=78.77, stdev=21.11 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 64], 20.00th=[ 67], 00:16:05.031 | 30.00th=[ 69], 40.00th=[ 70], 50.00th=[ 71], 60.00th=[ 73], 00:16:05.031 | 70.00th=[ 74], 80.00th=[ 76], 90.00th=[ 80], 95.00th=[ 82], 00:16:05.031 | 99.00th=[ 206], 99.50th=[ 249], 99.90th=[ 285], 99.95th=[ 293], 00:16:05.031 | 99.99th=[ 334] 00:16:05.031 write: IOPS=6333, BW=24.7MiB/s (25.9MB/s)(24.8MiB/1001msec); 0 zone resets 00:16:05.031 slat (nsec): min=6480, max=63851, avg=8795.92, stdev=2062.96 00:16:05.031 clat (usec): min=43, max=294, avg=68.25, stdev=16.08 00:16:05.031 lat (usec): min=51, max=324, avg=77.05, stdev=17.52 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 60], 20.00th=[ 63], 00:16:05.031 | 30.00th=[ 65], 40.00th=[ 67], 50.00th=[ 68], 60.00th=[ 69], 00:16:05.031 | 70.00th=[ 71], 80.00th=[ 73], 90.00th=[ 76], 95.00th=[ 78], 00:16:05.031 | 99.00th=[ 86], 99.50th=[ 239], 99.90th=[ 273], 99.95th=[ 277], 00:16:05.031 | 99.99th=[ 293] 00:16:05.031 bw ( KiB/s): min=25312, max=25312, per=32.58%, avg=25312.00, stdev= 0.00, samples=1 00:16:05.031 iops : min= 6328, max= 6328, avg=6328.00, stdev= 0.00, samples=1 00:16:05.031 lat (usec) : 50=0.79%, 100=98.30%, 250=0.48%, 500=0.43% 00:16:05.031 cpu : usr=6.30%, sys=10.40%, ctx=12486, majf=0, minf=1 00:16:05.031 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:05.031 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.031 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.031 issued rwts: total=6144,6340,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:05.031 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:05.031 job2: (groupid=0, jobs=1): err= 0: pid=3506249: Fri Apr 26 15:03:45 2024 00:16:05.031 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:16:05.031 slat (nsec): min=5575, max=74912, avg=12467.09, stdev=9458.27 00:16:05.031 clat (usec): min=57, max=370, avg=142.74, stdev=66.68 00:16:05.031 lat (usec): min=70, max=398, avg=155.21, stdev=73.70 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 70], 5.00th=[ 75], 10.00th=[ 79], 20.00th=[ 89], 00:16:05.031 | 30.00th=[ 104], 40.00th=[ 109], 50.00th=[ 112], 60.00th=[ 118], 00:16:05.031 | 70.00th=[ 151], 80.00th=[ 227], 90.00th=[ 249], 95.00th=[ 265], 00:16:05.031 | 99.00th=[ 297], 99.50th=[ 310], 99.90th=[ 338], 99.95th=[ 355], 00:16:05.031 | 99.99th=[ 371] 00:16:05.031 write: IOPS=3203, BW=12.5MiB/s (13.1MB/s)(12.5MiB/1001msec); 0 zone resets 00:16:05.031 slat (nsec): min=7738, max=66305, avg=15310.11, stdev=9813.47 00:16:05.031 clat (usec): min=61, max=345, avg=139.90, stdev=71.19 00:16:05.031 lat (usec): min=70, max=377, avg=155.21, stdev=78.64 00:16:05.031 clat percentiles (usec): 00:16:05.031 | 1.00th=[ 67], 5.00th=[ 71], 10.00th=[ 74], 20.00th=[ 81], 00:16:05.031 | 30.00th=[ 98], 40.00th=[ 102], 50.00th=[ 108], 60.00th=[ 113], 00:16:05.031 | 70.00th=[ 149], 80.00th=[ 229], 90.00th=[ 253], 95.00th=[ 273], 00:16:05.031 | 99.00th=[ 302], 99.50th=[ 318], 99.90th=[ 338], 99.95th=[ 338], 00:16:05.031 | 99.99th=[ 347] 00:16:05.031 bw ( KiB/s): min=13400, max=13400, per=17.25%, avg=13400.00, stdev= 0.00, samples=1 00:16:05.031 iops : min= 3350, max= 3350, avg=3350.00, stdev= 0.00, samples=1 00:16:05.031 lat (usec) : 100=29.75%, 250=59.95%, 500=10.30% 00:16:05.031 cpu : usr=4.70%, sys=9.60%, ctx=6280, majf=0, minf=1 00:16:05.032 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:05.032 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.032 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.032 issued rwts: total=3072,3207,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:05.032 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:05.032 job3: (groupid=0, jobs=1): err= 0: pid=3506250: Fri Apr 26 15:03:45 2024 00:16:05.032 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:16:05.032 slat (nsec): min=5498, max=49261, avg=10989.36, stdev=8683.21 00:16:05.032 clat (usec): min=61, max=348, avg=131.46, stdev=62.43 00:16:05.032 lat (usec): min=71, max=374, avg=142.44, stdev=68.89 00:16:05.032 clat percentiles (usec): 00:16:05.032 | 1.00th=[ 70], 5.00th=[ 73], 10.00th=[ 76], 20.00th=[ 81], 00:16:05.032 | 30.00th=[ 99], 40.00th=[ 105], 50.00th=[ 110], 60.00th=[ 114], 00:16:05.032 | 70.00th=[ 121], 80.00th=[ 208], 90.00th=[ 245], 95.00th=[ 260], 00:16:05.032 | 99.00th=[ 289], 99.50th=[ 302], 99.90th=[ 322], 99.95th=[ 347], 00:16:05.032 | 99.99th=[ 351] 00:16:05.032 write: IOPS=3515, BW=13.7MiB/s (14.4MB/s)(13.7MiB/1001msec); 0 zone resets 00:16:05.032 slat (nsec): min=7898, max=51546, avg=14976.69, stdev=9737.07 00:16:05.032 clat (usec): min=57, max=366, avg=137.76, stdev=70.42 00:16:05.032 lat (usec): min=70, max=384, avg=152.74, stdev=78.02 00:16:05.032 clat percentiles (usec): 00:16:05.032 | 1.00th=[ 67], 5.00th=[ 71], 10.00th=[ 74], 20.00th=[ 80], 00:16:05.032 | 30.00th=[ 97], 40.00th=[ 102], 50.00th=[ 106], 60.00th=[ 112], 00:16:05.032 | 70.00th=[ 126], 80.00th=[ 227], 90.00th=[ 253], 95.00th=[ 269], 00:16:05.032 | 99.00th=[ 302], 99.50th=[ 314], 99.90th=[ 338], 99.95th=[ 355], 00:16:05.032 | 99.99th=[ 367] 00:16:05.032 bw ( KiB/s): min=13832, max=13832, per=17.81%, avg=13832.00, stdev= 0.00, samples=1 00:16:05.032 iops : min= 3458, max= 3458, avg=3458.00, stdev= 0.00, samples=1 00:16:05.032 lat (usec) : 100=33.33%, 250=56.97%, 500=9.70% 00:16:05.032 cpu : usr=5.40%, sys=8.70%, ctx=6591, majf=0, minf=1 00:16:05.032 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:05.032 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.032 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:05.032 issued rwts: total=3072,3519,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:05.032 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:05.032 00:16:05.032 Run status group 0 (all jobs): 00:16:05.032 READ: bw=71.9MiB/s (75.4MB/s), 12.0MiB/s-24.0MiB/s (12.6MB/s-25.1MB/s), io=72.0MiB (75.5MB), run=1001-1001msec 00:16:05.032 WRITE: bw=75.9MiB/s (79.5MB/s), 12.5MiB/s-24.9MiB/s (13.1MB/s-26.1MB/s), io=75.9MiB (79.6MB), run=1001-1001msec 00:16:05.032 00:16:05.032 Disk stats (read/write): 00:16:05.032 nvme0n1: ios=5170/5450, merge=0/0, ticks=341/347, in_queue=688, util=85.87% 00:16:05.032 nvme0n2: ios=5120/5555, merge=0/0, ticks=359/351, in_queue=710, util=86.28% 00:16:05.032 nvme0n3: ios=2560/2783, merge=0/0, ticks=358/375, in_queue=733, util=88.71% 00:16:05.032 nvme0n4: ios=2560/3011, merge=0/0, ticks=334/396, in_queue=730, util=89.56% 00:16:05.032 15:03:45 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:05.032 [global] 00:16:05.032 thread=1 00:16:05.032 invalidate=1 00:16:05.032 rw=write 00:16:05.032 time_based=1 00:16:05.032 runtime=1 00:16:05.032 ioengine=libaio 00:16:05.032 direct=1 00:16:05.032 bs=4096 00:16:05.032 iodepth=128 00:16:05.032 norandommap=0 00:16:05.032 numjobs=1 00:16:05.032 00:16:05.032 verify_dump=1 00:16:05.032 verify_backlog=512 00:16:05.032 verify_state_save=0 00:16:05.032 do_verify=1 00:16:05.032 verify=crc32c-intel 00:16:05.032 [job0] 00:16:05.032 filename=/dev/nvme0n1 00:16:05.032 [job1] 00:16:05.032 filename=/dev/nvme0n2 00:16:05.032 [job2] 00:16:05.032 filename=/dev/nvme0n3 00:16:05.032 [job3] 00:16:05.032 filename=/dev/nvme0n4 00:16:05.032 Could not set queue depth (nvme0n1) 00:16:05.032 Could not set queue depth (nvme0n2) 00:16:05.032 Could not set queue depth (nvme0n3) 00:16:05.032 Could not set queue depth (nvme0n4) 00:16:05.291 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:05.291 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:05.291 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:05.291 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:05.291 fio-3.35 00:16:05.291 Starting 4 threads 00:16:06.677 00:16:06.677 job0: (groupid=0, jobs=1): err= 0: pid=3506766: Fri Apr 26 15:03:47 2024 00:16:06.677 read: IOPS=5022, BW=19.6MiB/s (20.6MB/s)(19.6MiB/1001msec) 00:16:06.677 slat (nsec): min=1203, max=6694.9k, avg=99515.24, stdev=441826.21 00:16:06.677 clat (usec): min=816, max=25999, avg=12865.99, stdev=6521.87 00:16:06.677 lat (usec): min=1478, max=26007, avg=12965.51, stdev=6571.62 00:16:06.677 clat percentiles (usec): 00:16:06.677 | 1.00th=[ 2835], 5.00th=[ 3163], 10.00th=[ 3884], 20.00th=[ 5604], 00:16:06.678 | 30.00th=[ 7308], 40.00th=[ 9503], 50.00th=[13304], 60.00th=[16712], 00:16:06.678 | 70.00th=[19006], 80.00th=[19792], 90.00th=[20579], 95.00th=[20841], 00:16:06.678 | 99.00th=[21627], 99.50th=[22152], 99.90th=[25035], 99.95th=[25822], 00:16:06.678 | 99.99th=[26084] 00:16:06.678 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:16:06.678 slat (nsec): min=1727, max=6513.2k, avg=94016.31, stdev=390120.67 00:16:06.678 clat (usec): min=1690, max=27406, avg=12060.00, stdev=6833.85 00:16:06.678 lat (usec): min=1823, max=27729, avg=12154.02, stdev=6884.53 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 2442], 5.00th=[ 3097], 10.00th=[ 3654], 20.00th=[ 4948], 00:16:06.678 | 30.00th=[ 5407], 40.00th=[ 7439], 50.00th=[12256], 60.00th=[16712], 00:16:06.678 | 70.00th=[18744], 80.00th=[19530], 90.00th=[20055], 95.00th=[20579], 00:16:06.678 | 99.00th=[21890], 99.50th=[22414], 99.90th=[25297], 99.95th=[27395], 00:16:06.678 | 99.99th=[27395] 00:16:06.678 bw ( KiB/s): min=23168, max=23168, per=30.39%, avg=23168.00, stdev= 0.00, samples=1 00:16:06.678 iops : min= 5792, max= 5792, avg=5792.00, stdev= 0.00, samples=1 00:16:06.678 lat (usec) : 1000=0.01% 00:16:06.678 lat (msec) : 2=0.33%, 4=11.42%, 10=31.72%, 20=42.87%, 50=13.66% 00:16:06.678 cpu : usr=2.00%, sys=4.20%, ctx=1593, majf=0, minf=1 00:16:06.678 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:06.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:06.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:06.678 issued rwts: total=5028,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:06.678 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:06.678 job1: (groupid=0, jobs=1): err= 0: pid=3506767: Fri Apr 26 15:03:47 2024 00:16:06.678 read: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec) 00:16:06.678 slat (nsec): min=1170, max=6433.5k, avg=111614.83, stdev=376113.88 00:16:06.678 clat (usec): min=2643, max=25784, avg=13868.71, stdev=6091.61 00:16:06.678 lat (usec): min=3370, max=25786, avg=13980.32, stdev=6128.76 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 3785], 5.00th=[ 4817], 10.00th=[ 5211], 20.00th=[ 6849], 00:16:06.678 | 30.00th=[ 9110], 40.00th=[11469], 50.00th=[14877], 60.00th=[17695], 00:16:06.678 | 70.00th=[19006], 80.00th=[19792], 90.00th=[20579], 95.00th=[21627], 00:16:06.678 | 99.00th=[24249], 99.50th=[24773], 99.90th=[25297], 99.95th=[25822], 00:16:06.678 | 99.99th=[25822] 00:16:06.678 write: IOPS=4614, BW=18.0MiB/s (18.9MB/s)(18.1MiB/1004msec); 0 zone resets 00:16:06.678 slat (nsec): min=1707, max=4108.9k, avg=101885.29, stdev=351339.05 00:16:06.678 clat (usec): min=1677, max=26087, avg=13627.89, stdev=5779.60 00:16:06.678 lat (usec): min=2643, max=26089, avg=13729.77, stdev=5814.27 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 3163], 5.00th=[ 3982], 10.00th=[ 4883], 20.00th=[ 7111], 00:16:06.678 | 30.00th=[ 9896], 40.00th=[12125], 50.00th=[15139], 60.00th=[17957], 00:16:06.678 | 70.00th=[18482], 80.00th=[19006], 90.00th=[19792], 95.00th=[20579], 00:16:06.678 | 99.00th=[21890], 99.50th=[22676], 99.90th=[25560], 99.95th=[26084], 00:16:06.678 | 99.99th=[26084] 00:16:06.678 bw ( KiB/s): min=16384, max=20480, per=24.17%, avg=18432.00, stdev=2896.31, samples=2 00:16:06.678 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:06.678 lat (msec) : 2=0.01%, 4=3.33%, 10=29.00%, 20=55.33%, 50=12.33% 00:16:06.678 cpu : usr=2.39%, sys=3.49%, ctx=2085, majf=0, minf=1 00:16:06.678 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:06.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:06.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:06.678 issued rwts: total=4608,4633,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:06.678 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:06.678 job2: (groupid=0, jobs=1): err= 0: pid=3506768: Fri Apr 26 15:03:47 2024 00:16:06.678 read: IOPS=4177, BW=16.3MiB/s (17.1MB/s)(16.4MiB/1004msec) 00:16:06.678 slat (nsec): min=1212, max=6406.6k, avg=123624.55, stdev=484399.10 00:16:06.678 clat (usec): min=2266, max=24205, avg=16276.37, stdev=4907.49 00:16:06.678 lat (usec): min=2268, max=24214, avg=16399.99, stdev=4931.94 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 4621], 5.00th=[ 6456], 10.00th=[ 8094], 20.00th=[11076], 00:16:06.678 | 30.00th=[14615], 40.00th=[17957], 50.00th=[18220], 60.00th=[19268], 00:16:06.678 | 70.00th=[19530], 80.00th=[20055], 90.00th=[20841], 95.00th=[21365], 00:16:06.678 | 99.00th=[21890], 99.50th=[22676], 99.90th=[23462], 99.95th=[23725], 00:16:06.678 | 99.99th=[24249] 00:16:06.678 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:16:06.678 slat (nsec): min=1768, max=7449.4k, avg=100717.76, stdev=373121.08 00:16:06.678 clat (usec): min=1131, max=23415, avg=12786.78, stdev=5775.64 00:16:06.678 lat (usec): min=1140, max=23442, avg=12887.50, stdev=5817.02 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 3425], 5.00th=[ 4752], 10.00th=[ 5407], 20.00th=[ 6194], 00:16:06.678 | 30.00th=[ 7963], 40.00th=[10421], 50.00th=[12780], 60.00th=[15664], 00:16:06.678 | 70.00th=[18220], 80.00th=[19006], 90.00th=[19792], 95.00th=[20055], 00:16:06.678 | 99.00th=[21627], 99.50th=[21890], 99.90th=[22938], 99.95th=[22938], 00:16:06.678 | 99.99th=[23462] 00:16:06.678 bw ( KiB/s): min=17448, max=19184, per=24.02%, avg=18316.00, stdev=1227.54, samples=2 00:16:06.678 iops : min= 4362, max= 4796, avg=4579.00, stdev=306.88, samples=2 00:16:06.678 lat (msec) : 2=0.12%, 4=1.50%, 10=25.94%, 20=58.26%, 50=14.18% 00:16:06.678 cpu : usr=1.99%, sys=3.79%, ctx=2028, majf=0, minf=1 00:16:06.678 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:06.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:06.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:06.678 issued rwts: total=4194,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:06.678 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:06.678 job3: (groupid=0, jobs=1): err= 0: pid=3506770: Fri Apr 26 15:03:47 2024 00:16:06.678 read: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec) 00:16:06.678 slat (nsec): min=1247, max=5728.2k, avg=104360.10, stdev=364108.74 00:16:06.678 clat (usec): min=2491, max=22963, avg=13449.87, stdev=6041.77 00:16:06.678 lat (usec): min=2494, max=23576, avg=13554.23, stdev=6083.87 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 3163], 5.00th=[ 4080], 10.00th=[ 4621], 20.00th=[ 5473], 00:16:06.678 | 30.00th=[ 9372], 40.00th=[11994], 50.00th=[14615], 60.00th=[17957], 00:16:06.678 | 70.00th=[18744], 80.00th=[19530], 90.00th=[20055], 95.00th=[20317], 00:16:06.678 | 99.00th=[21365], 99.50th=[22414], 99.90th=[22414], 99.95th=[22414], 00:16:06.678 | 99.99th=[22938] 00:16:06.678 write: IOPS=4757, BW=18.6MiB/s (19.5MB/s)(18.7MiB/1004msec); 0 zone resets 00:16:06.678 slat (nsec): min=1746, max=5878.0k, avg=105551.55, stdev=404145.45 00:16:06.678 clat (usec): min=1622, max=23528, avg=13557.89, stdev=5622.67 00:16:06.678 lat (usec): min=2533, max=23541, avg=13663.44, stdev=5656.65 00:16:06.678 clat percentiles (usec): 00:16:06.678 | 1.00th=[ 2999], 5.00th=[ 4146], 10.00th=[ 5211], 20.00th=[ 7111], 00:16:06.678 | 30.00th=[ 9634], 40.00th=[12256], 50.00th=[14222], 60.00th=[17171], 00:16:06.678 | 70.00th=[18482], 80.00th=[19006], 90.00th=[20055], 95.00th=[20579], 00:16:06.678 | 99.00th=[21365], 99.50th=[21365], 99.90th=[22152], 99.95th=[22676], 00:16:06.678 | 99.99th=[23462] 00:16:06.678 bw ( KiB/s): min=12616, max=24576, per=24.39%, avg=18596.00, stdev=8457.00, samples=2 00:16:06.678 iops : min= 3154, max= 6144, avg=4649.00, stdev=2114.25, samples=2 00:16:06.678 lat (msec) : 2=0.01%, 4=3.90%, 10=28.18%, 20=58.12%, 50=9.78% 00:16:06.678 cpu : usr=1.69%, sys=4.59%, ctx=2054, majf=0, minf=1 00:16:06.678 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:06.678 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:06.678 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:06.678 issued rwts: total=4608,4777,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:06.678 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:06.678 00:16:06.678 Run status group 0 (all jobs): 00:16:06.678 READ: bw=71.7MiB/s (75.2MB/s), 16.3MiB/s-19.6MiB/s (17.1MB/s-20.6MB/s), io=72.0MiB (75.5MB), run=1001-1004msec 00:16:06.678 WRITE: bw=74.5MiB/s (78.1MB/s), 17.9MiB/s-20.0MiB/s (18.8MB/s-20.9MB/s), io=74.8MiB (78.4MB), run=1001-1004msec 00:16:06.678 00:16:06.678 Disk stats (read/write): 00:16:06.678 nvme0n1: ios=3752/4096, merge=0/0, ticks=15498/17580, in_queue=33078, util=85.07% 00:16:06.678 nvme0n2: ios=3584/4043, merge=0/0, ticks=16342/15251, in_queue=31593, util=85.87% 00:16:06.678 nvme0n3: ios=3562/3584, merge=0/0, ticks=16912/14852, in_queue=31764, util=87.46% 00:16:06.678 nvme0n4: ios=4036/4096, merge=0/0, ticks=15899/16010, in_queue=31909, util=89.35% 00:16:06.678 15:03:47 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:06.678 [global] 00:16:06.678 thread=1 00:16:06.678 invalidate=1 00:16:06.678 rw=randwrite 00:16:06.678 time_based=1 00:16:06.678 runtime=1 00:16:06.678 ioengine=libaio 00:16:06.678 direct=1 00:16:06.678 bs=4096 00:16:06.678 iodepth=128 00:16:06.678 norandommap=0 00:16:06.678 numjobs=1 00:16:06.678 00:16:06.678 verify_dump=1 00:16:06.678 verify_backlog=512 00:16:06.678 verify_state_save=0 00:16:06.678 do_verify=1 00:16:06.678 verify=crc32c-intel 00:16:06.678 [job0] 00:16:06.678 filename=/dev/nvme0n1 00:16:06.678 [job1] 00:16:06.678 filename=/dev/nvme0n2 00:16:06.678 [job2] 00:16:06.678 filename=/dev/nvme0n3 00:16:06.678 [job3] 00:16:06.678 filename=/dev/nvme0n4 00:16:06.678 Could not set queue depth (nvme0n1) 00:16:06.678 Could not set queue depth (nvme0n2) 00:16:06.678 Could not set queue depth (nvme0n3) 00:16:06.678 Could not set queue depth (nvme0n4) 00:16:06.938 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:06.938 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:06.938 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:06.938 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:06.938 fio-3.35 00:16:06.938 Starting 4 threads 00:16:08.320 00:16:08.320 job0: (groupid=0, jobs=1): err= 0: pid=3507294: Fri Apr 26 15:03:48 2024 00:16:08.320 read: IOPS=5726, BW=22.4MiB/s (23.5MB/s)(22.5MiB/1004msec) 00:16:08.320 slat (nsec): min=1198, max=4454.1k, avg=84057.77, stdev=371713.89 00:16:08.320 clat (usec): min=2276, max=21142, avg=10532.76, stdev=3236.09 00:16:08.320 lat (usec): min=2284, max=22392, avg=10616.81, stdev=3243.48 00:16:08.320 clat percentiles (usec): 00:16:08.320 | 1.00th=[ 3064], 5.00th=[ 3851], 10.00th=[ 6521], 20.00th=[10028], 00:16:08.320 | 30.00th=[10421], 40.00th=[10552], 50.00th=[10552], 60.00th=[10683], 00:16:08.320 | 70.00th=[10814], 80.00th=[10945], 90.00th=[14484], 95.00th=[17695], 00:16:08.320 | 99.00th=[20055], 99.50th=[20317], 99.90th=[20841], 99.95th=[20841], 00:16:08.320 | 99.99th=[21103] 00:16:08.320 write: IOPS=6119, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1004msec); 0 zone resets 00:16:08.320 slat (nsec): min=1664, max=4446.2k, avg=81289.72, stdev=350660.26 00:16:08.320 clat (usec): min=1795, max=20314, avg=10820.62, stdev=3833.13 00:16:08.320 lat (usec): min=1802, max=23232, avg=10901.91, stdev=3844.40 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[ 2737], 5.00th=[ 3851], 10.00th=[ 6194], 20.00th=[ 8586], 00:16:08.321 | 30.00th=[10028], 40.00th=[10290], 50.00th=[10421], 60.00th=[10552], 00:16:08.321 | 70.00th=[10552], 80.00th=[13566], 90.00th=[17433], 95.00th=[17695], 00:16:08.321 | 99.00th=[19268], 99.50th=[19530], 99.90th=[20317], 99.95th=[20317], 00:16:08.321 | 99.99th=[20317] 00:16:08.321 bw ( KiB/s): min=24488, max=24576, per=27.13%, avg=24532.00, stdev=62.23, samples=2 00:16:08.321 iops : min= 6122, max= 6144, avg=6133.00, stdev=15.56, samples=2 00:16:08.321 lat (msec) : 2=0.13%, 4=5.57%, 10=17.75%, 20=75.91%, 50=0.64% 00:16:08.321 cpu : usr=2.69%, sys=3.19%, ctx=1241, majf=0, minf=1 00:16:08.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:08.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:08.321 issued rwts: total=5749,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:08.321 job1: (groupid=0, jobs=1): err= 0: pid=3507295: Fri Apr 26 15:03:48 2024 00:16:08.321 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:16:08.321 slat (nsec): min=1202, max=4713.6k, avg=93576.98, stdev=322865.19 00:16:08.321 clat (usec): min=8136, max=19686, avg=11961.49, stdev=2800.05 00:16:08.321 lat (usec): min=8537, max=19694, avg=12055.07, stdev=2804.63 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[ 9110], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10421], 00:16:08.321 | 30.00th=[10421], 40.00th=[10552], 50.00th=[10683], 60.00th=[10814], 00:16:08.321 | 70.00th=[10814], 80.00th=[14484], 90.00th=[17433], 95.00th=[17957], 00:16:08.321 | 99.00th=[18482], 99.50th=[19268], 99.90th=[19268], 99.95th=[19792], 00:16:08.321 | 99.99th=[19792] 00:16:08.321 write: IOPS=5372, BW=21.0MiB/s (22.0MB/s)(21.1MiB/1004msec); 0 zone resets 00:16:08.321 slat (nsec): min=1705, max=4615.3k, avg=93573.86, stdev=337211.54 00:16:08.321 clat (usec): min=1927, max=20604, avg=12135.31, stdev=3230.28 00:16:08.321 lat (usec): min=3999, max=20612, avg=12228.89, stdev=3238.55 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[ 8586], 5.00th=[ 9634], 10.00th=[ 9896], 20.00th=[10159], 00:16:08.321 | 30.00th=[10421], 40.00th=[10421], 50.00th=[10552], 60.00th=[10552], 00:16:08.321 | 70.00th=[10683], 80.00th=[16450], 90.00th=[17695], 95.00th=[18744], 00:16:08.321 | 99.00th=[19792], 99.50th=[20055], 99.90th=[20317], 99.95th=[20317], 00:16:08.321 | 99.99th=[20579] 00:16:08.321 bw ( KiB/s): min=19648, max=22480, per=23.29%, avg=21064.00, stdev=2002.53, samples=2 00:16:08.321 iops : min= 4912, max= 5620, avg=5266.00, stdev=500.63, samples=2 00:16:08.321 lat (msec) : 2=0.01%, 4=0.01%, 10=9.95%, 20=89.67%, 50=0.36% 00:16:08.321 cpu : usr=1.40%, sys=3.89%, ctx=1393, majf=0, minf=1 00:16:08.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:08.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:08.321 issued rwts: total=5120,5394,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:08.321 job2: (groupid=0, jobs=1): err= 0: pid=3507297: Fri Apr 26 15:03:48 2024 00:16:08.321 read: IOPS=4454, BW=17.4MiB/s (18.2MB/s)(17.5MiB/1004msec) 00:16:08.321 slat (nsec): min=1209, max=2967.7k, avg=111338.65, stdev=390014.17 00:16:08.321 clat (usec): min=2078, max=19954, avg=14047.79, stdev=2123.65 00:16:08.321 lat (usec): min=3527, max=19961, avg=14159.13, stdev=2101.07 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[10421], 5.00th=[11994], 10.00th=[12649], 20.00th=[13042], 00:16:08.321 | 30.00th=[13042], 40.00th=[13173], 50.00th=[13173], 60.00th=[13304], 00:16:08.321 | 70.00th=[13435], 80.00th=[16909], 90.00th=[17695], 95.00th=[17957], 00:16:08.321 | 99.00th=[19006], 99.50th=[19006], 99.90th=[20055], 99.95th=[20055], 00:16:08.321 | 99.99th=[20055] 00:16:08.321 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:16:08.321 slat (nsec): min=1730, max=3450.6k, avg=106165.94, stdev=372366.39 00:16:08.321 clat (usec): min=9668, max=21018, avg=13863.68, stdev=2440.72 00:16:08.321 lat (usec): min=9676, max=21042, avg=13969.85, stdev=2430.75 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[10552], 5.00th=[11600], 10.00th=[12256], 20.00th=[12387], 00:16:08.321 | 30.00th=[12518], 40.00th=[12518], 50.00th=[12649], 60.00th=[12780], 00:16:08.321 | 70.00th=[13304], 80.00th=[16712], 90.00th=[18220], 95.00th=[19006], 00:16:08.321 | 99.00th=[20055], 99.50th=[20317], 99.90th=[20841], 99.95th=[20841], 00:16:08.321 | 99.99th=[21103] 00:16:08.321 bw ( KiB/s): min=16384, max=20480, per=20.38%, avg=18432.00, stdev=2896.31, samples=2 00:16:08.321 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:16:08.321 lat (msec) : 4=0.03%, 10=0.57%, 20=98.77%, 50=0.63% 00:16:08.321 cpu : usr=1.60%, sys=3.49%, ctx=1213, majf=0, minf=1 00:16:08.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:08.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:08.321 issued rwts: total=4472,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:08.321 job3: (groupid=0, jobs=1): err= 0: pid=3507299: Fri Apr 26 15:03:48 2024 00:16:08.321 read: IOPS=6137, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1001msec) 00:16:08.321 slat (nsec): min=1228, max=4167.2k, avg=80012.91, stdev=342255.88 00:16:08.321 clat (usec): min=4383, max=18415, avg=10412.73, stdev=3200.61 00:16:08.321 lat (usec): min=4518, max=18421, avg=10492.74, stdev=3210.62 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[ 5604], 5.00th=[ 5997], 10.00th=[ 6259], 20.00th=[ 6587], 00:16:08.321 | 30.00th=[ 6980], 40.00th=[ 8848], 50.00th=[12649], 60.00th=[13042], 00:16:08.321 | 70.00th=[13042], 80.00th=[13173], 90.00th=[13304], 95.00th=[13435], 00:16:08.321 | 99.00th=[14746], 99.50th=[18220], 99.90th=[18482], 99.95th=[18482], 00:16:08.321 | 99.99th=[18482] 00:16:08.321 write: IOPS=6544, BW=25.6MiB/s (26.8MB/s)(25.6MiB/1001msec); 0 zone resets 00:16:08.321 slat (nsec): min=1734, max=4261.9k, avg=74071.80, stdev=322103.18 00:16:08.321 clat (usec): min=292, max=19142, avg=9581.66, stdev=3432.18 00:16:08.321 lat (usec): min=980, max=19150, avg=9655.73, stdev=3445.29 00:16:08.321 clat percentiles (usec): 00:16:08.321 | 1.00th=[ 4146], 5.00th=[ 5669], 10.00th=[ 5866], 20.00th=[ 6194], 00:16:08.321 | 30.00th=[ 6325], 40.00th=[ 6652], 50.00th=[10683], 60.00th=[12387], 00:16:08.321 | 70.00th=[12387], 80.00th=[12518], 90.00th=[12780], 95.00th=[13304], 00:16:08.321 | 99.00th=[18482], 99.50th=[18744], 99.90th=[19006], 99.95th=[19006], 00:16:08.321 | 99.99th=[19268] 00:16:08.321 bw ( KiB/s): min=28672, max=28672, per=31.71%, avg=28672.00, stdev= 0.00, samples=1 00:16:08.321 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:16:08.321 lat (usec) : 500=0.01%, 1000=0.06% 00:16:08.321 lat (msec) : 2=0.20%, 4=0.25%, 10=44.54%, 20=54.95% 00:16:08.321 cpu : usr=2.30%, sys=5.10%, ctx=1175, majf=0, minf=1 00:16:08.321 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:08.321 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:08.321 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:08.321 issued rwts: total=6144,6551,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:08.321 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:08.321 00:16:08.321 Run status group 0 (all jobs): 00:16:08.321 READ: bw=83.6MiB/s (87.7MB/s), 17.4MiB/s-24.0MiB/s (18.2MB/s-25.1MB/s), io=83.9MiB (88.0MB), run=1001-1004msec 00:16:08.321 WRITE: bw=88.3MiB/s (92.6MB/s), 17.9MiB/s-25.6MiB/s (18.8MB/s-26.8MB/s), io=88.7MiB (93.0MB), run=1001-1004msec 00:16:08.321 00:16:08.321 Disk stats (read/write): 00:16:08.321 nvme0n1: ios=5128/5120, merge=0/0, ticks=13757/13619, in_queue=27376, util=85.77% 00:16:08.321 nvme0n2: ios=4233/4608, merge=0/0, ticks=12923/13960, in_queue=26883, util=86.28% 00:16:08.321 nvme0n3: ios=3584/4069, merge=0/0, ticks=12712/14168, in_queue=26880, util=88.71% 00:16:08.321 nvme0n4: ios=5120/5608, merge=0/0, ticks=13296/13152, in_queue=26448, util=89.56% 00:16:08.321 15:03:48 -- target/fio.sh@55 -- # sync 00:16:08.321 15:03:48 -- target/fio.sh@59 -- # fio_pid=3507625 00:16:08.321 15:03:48 -- target/fio.sh@61 -- # sleep 3 00:16:08.321 15:03:48 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:08.321 [global] 00:16:08.321 thread=1 00:16:08.321 invalidate=1 00:16:08.321 rw=read 00:16:08.321 time_based=1 00:16:08.321 runtime=10 00:16:08.321 ioengine=libaio 00:16:08.321 direct=1 00:16:08.321 bs=4096 00:16:08.321 iodepth=1 00:16:08.321 norandommap=1 00:16:08.321 numjobs=1 00:16:08.321 00:16:08.321 [job0] 00:16:08.321 filename=/dev/nvme0n1 00:16:08.321 [job1] 00:16:08.321 filename=/dev/nvme0n2 00:16:08.321 [job2] 00:16:08.321 filename=/dev/nvme0n3 00:16:08.321 [job3] 00:16:08.321 filename=/dev/nvme0n4 00:16:08.321 Could not set queue depth (nvme0n1) 00:16:08.321 Could not set queue depth (nvme0n2) 00:16:08.321 Could not set queue depth (nvme0n3) 00:16:08.321 Could not set queue depth (nvme0n4) 00:16:08.582 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:08.582 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:08.582 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:08.582 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:08.582 fio-3.35 00:16:08.582 Starting 4 threads 00:16:11.199 15:03:51 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:11.199 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=58560512, buflen=4096 00:16:11.199 fio: pid=3507825, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:11.199 15:03:52 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:11.460 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=66154496, buflen=4096 00:16:11.460 fio: pid=3507824, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:11.460 15:03:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:11.460 15:03:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:11.460 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=22368256, buflen=4096 00:16:11.460 fio: pid=3507822, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:11.460 15:03:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:11.460 15:03:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:11.721 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=24064000, buflen=4096 00:16:11.721 fio: pid=3507823, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:11.721 15:03:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:11.721 15:03:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:11.721 00:16:11.721 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3507822: Fri Apr 26 15:03:52 2024 00:16:11.721 read: IOPS=13.3k, BW=52.0MiB/s (54.5MB/s)(149MiB/2873msec) 00:16:11.721 slat (usec): min=5, max=15926, avg= 8.38, stdev=151.37 00:16:11.721 clat (usec): min=29, max=537, avg=65.47, stdev=39.62 00:16:11.721 lat (usec): min=47, max=16006, avg=73.85, stdev=157.89 00:16:11.721 clat percentiles (usec): 00:16:11.721 | 1.00th=[ 46], 5.00th=[ 48], 10.00th=[ 49], 20.00th=[ 51], 00:16:11.721 | 30.00th=[ 52], 40.00th=[ 54], 50.00th=[ 56], 60.00th=[ 57], 00:16:11.721 | 70.00th=[ 60], 80.00th=[ 68], 90.00th=[ 76], 95.00th=[ 101], 00:16:11.721 | 99.00th=[ 273], 99.50th=[ 289], 99.90th=[ 326], 99.95th=[ 343], 00:16:11.721 | 99.99th=[ 379] 00:16:11.721 bw ( KiB/s): min=34808, max=65856, per=44.55%, avg=53142.40, stdev=12993.93, samples=5 00:16:11.721 iops : min= 8702, max=16464, avg=13285.60, stdev=3248.48, samples=5 00:16:11.721 lat (usec) : 50=15.75%, 100=79.22%, 250=3.27%, 500=1.75%, 750=0.01% 00:16:11.721 cpu : usr=3.86%, sys=11.73%, ctx=38236, majf=0, minf=1 00:16:11.721 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:11.721 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 issued rwts: total=38230,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:11.721 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:11.721 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3507823: Fri Apr 26 15:03:52 2024 00:16:11.721 read: IOPS=7300, BW=28.5MiB/s (29.9MB/s)(86.9MiB/3049msec) 00:16:11.721 slat (usec): min=5, max=22566, avg=14.91, stdev=271.00 00:16:11.721 clat (usec): min=42, max=539, avg=119.77, stdev=73.78 00:16:11.721 lat (usec): min=49, max=22785, avg=134.68, stdev=283.99 00:16:11.721 clat percentiles (usec): 00:16:11.721 | 1.00th=[ 56], 5.00th=[ 60], 10.00th=[ 63], 20.00th=[ 67], 00:16:11.721 | 30.00th=[ 70], 40.00th=[ 73], 50.00th=[ 78], 60.00th=[ 97], 00:16:11.721 | 70.00th=[ 131], 80.00th=[ 206], 90.00th=[ 247], 95.00th=[ 269], 00:16:11.721 | 99.00th=[ 306], 99.50th=[ 318], 99.90th=[ 355], 99.95th=[ 363], 00:16:11.721 | 99.99th=[ 457] 00:16:11.721 bw ( KiB/s): min=20064, max=47056, per=22.18%, avg=26459.20, stdev=11582.08, samples=5 00:16:11.721 iops : min= 5016, max=11764, avg=6614.80, stdev=2895.52, samples=5 00:16:11.721 lat (usec) : 50=0.15%, 100=61.27%, 250=29.41%, 500=9.16%, 750=0.01% 00:16:11.721 cpu : usr=3.48%, sys=8.99%, ctx=22266, majf=0, minf=1 00:16:11.721 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:11.721 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 issued rwts: total=22260,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:11.721 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:11.721 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3507824: Fri Apr 26 15:03:52 2024 00:16:11.721 read: IOPS=5973, BW=23.3MiB/s (24.5MB/s)(63.1MiB/2704msec) 00:16:11.721 slat (usec): min=3, max=15793, avg=14.82, stdev=175.82 00:16:11.721 clat (usec): min=60, max=572, avg=149.77, stdev=72.11 00:16:11.721 lat (usec): min=68, max=16047, avg=164.59, stdev=193.16 00:16:11.721 clat percentiles (usec): 00:16:11.721 | 1.00th=[ 70], 5.00th=[ 75], 10.00th=[ 78], 20.00th=[ 83], 00:16:11.721 | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 143], 00:16:11.721 | 70.00th=[ 206], 80.00th=[ 237], 90.00th=[ 260], 95.00th=[ 277], 00:16:11.721 | 99.00th=[ 310], 99.50th=[ 322], 99.90th=[ 351], 99.95th=[ 363], 00:16:11.721 | 99.99th=[ 457] 00:16:11.721 bw ( KiB/s): min=19776, max=27592, per=19.52%, avg=23283.20, stdev=3380.79, samples=5 00:16:11.721 iops : min= 4944, max= 6898, avg=5820.80, stdev=845.20, samples=5 00:16:11.721 lat (usec) : 100=33.76%, 250=53.50%, 500=12.72%, 750=0.01% 00:16:11.721 cpu : usr=3.26%, sys=8.95%, ctx=16155, majf=0, minf=1 00:16:11.721 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:11.721 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 issued rwts: total=16152,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:11.721 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:11.721 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3507825: Fri Apr 26 15:03:52 2024 00:16:11.721 read: IOPS=5649, BW=22.1MiB/s (23.1MB/s)(55.8MiB/2531msec) 00:16:11.721 slat (nsec): min=5426, max=63073, avg=13685.84, stdev=9957.54 00:16:11.721 clat (usec): min=51, max=582, avg=160.32, stdev=71.34 00:16:11.721 lat (usec): min=69, max=588, avg=174.01, stdev=77.50 00:16:11.721 clat percentiles (usec): 00:16:11.721 | 1.00th=[ 70], 5.00th=[ 76], 10.00th=[ 82], 20.00th=[ 98], 00:16:11.721 | 30.00th=[ 109], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 155], 00:16:11.721 | 70.00th=[ 212], 80.00th=[ 243], 90.00th=[ 265], 95.00th=[ 281], 00:16:11.721 | 99.00th=[ 314], 99.50th=[ 326], 99.90th=[ 355], 99.95th=[ 359], 00:16:11.721 | 99.99th=[ 412] 00:16:11.721 bw ( KiB/s): min=19816, max=26672, per=18.96%, avg=22625.60, stdev=2554.95, samples=5 00:16:11.721 iops : min= 4954, max= 6668, avg=5656.40, stdev=638.74, samples=5 00:16:11.721 lat (usec) : 100=21.79%, 250=62.90%, 500=15.30%, 750=0.01% 00:16:11.721 cpu : usr=2.89%, sys=9.29%, ctx=14298, majf=0, minf=2 00:16:11.721 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:11.721 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:11.721 issued rwts: total=14298,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:11.721 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:11.721 00:16:11.721 Run status group 0 (all jobs): 00:16:11.721 READ: bw=117MiB/s (122MB/s), 22.1MiB/s-52.0MiB/s (23.1MB/s-54.5MB/s), io=355MiB (372MB), run=2531-3049msec 00:16:11.721 00:16:11.721 Disk stats (read/write): 00:16:11.721 nvme0n1: ios=37177/0, merge=0/0, ticks=2227/0, in_queue=2227, util=91.89% 00:16:11.721 nvme0n2: ios=19405/0, merge=0/0, ticks=2358/0, in_queue=2358, util=92.56% 00:16:11.721 nvme0n3: ios=15025/0, merge=0/0, ticks=2192/0, in_queue=2192, util=95.77% 00:16:11.721 nvme0n4: ios=12918/0, merge=0/0, ticks=1989/0, in_queue=1989, util=96.01% 00:16:11.982 15:03:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:11.982 15:03:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:11.982 15:03:52 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:11.982 15:03:52 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:12.243 15:03:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:12.243 15:03:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:12.507 15:03:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:12.507 15:03:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:12.767 15:03:53 -- target/fio.sh@69 -- # fio_status=0 00:16:12.767 15:03:53 -- target/fio.sh@70 -- # wait 3507625 00:16:12.767 15:03:53 -- target/fio.sh@70 -- # fio_status=4 00:16:12.767 15:03:53 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:16.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:16.972 15:03:57 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:16.972 15:03:57 -- common/autotest_common.sh@1215 -- # local i=0 00:16:16.972 15:03:57 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:16:16.972 15:03:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:16.972 15:03:57 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:16:16.972 15:03:57 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:16.972 15:03:57 -- common/autotest_common.sh@1227 -- # return 0 00:16:16.972 15:03:57 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:16.972 15:03:57 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:16.972 nvmf hotplug test: fio failed as expected 00:16:16.972 15:03:57 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:17.233 15:03:57 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:17.233 15:03:57 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:17.233 15:03:57 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:17.233 15:03:57 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:17.233 15:03:57 -- target/fio.sh@91 -- # nvmftestfini 00:16:17.233 15:03:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:17.233 15:03:57 -- nvmf/common.sh@117 -- # sync 00:16:17.233 15:03:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:17.233 15:03:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:17.233 15:03:57 -- nvmf/common.sh@120 -- # set +e 00:16:17.233 15:03:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:17.233 15:03:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:17.233 rmmod nvme_rdma 00:16:17.233 rmmod nvme_fabrics 00:16:17.233 15:03:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:17.233 15:03:58 -- nvmf/common.sh@124 -- # set -e 00:16:17.233 15:03:58 -- nvmf/common.sh@125 -- # return 0 00:16:17.233 15:03:58 -- nvmf/common.sh@478 -- # '[' -n 3503121 ']' 00:16:17.233 15:03:58 -- nvmf/common.sh@479 -- # killprocess 3503121 00:16:17.233 15:03:58 -- common/autotest_common.sh@946 -- # '[' -z 3503121 ']' 00:16:17.233 15:03:58 -- common/autotest_common.sh@950 -- # kill -0 3503121 00:16:17.233 15:03:58 -- common/autotest_common.sh@951 -- # uname 00:16:17.233 15:03:58 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:16:17.233 15:03:58 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3503121 00:16:17.233 15:03:58 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:16:17.233 15:03:58 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:16:17.233 15:03:58 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3503121' 00:16:17.233 killing process with pid 3503121 00:16:17.233 15:03:58 -- common/autotest_common.sh@965 -- # kill 3503121 00:16:17.233 15:03:58 -- common/autotest_common.sh@970 -- # wait 3503121 00:16:17.233 [2024-04-26 15:03:58.146204] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:17.495 15:03:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:17.495 15:03:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:17.495 00:16:17.495 real 0m34.637s 00:16:17.495 user 3m9.606s 00:16:17.495 sys 0m10.427s 00:16:17.495 15:03:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:16:17.495 15:03:58 -- common/autotest_common.sh@10 -- # set +x 00:16:17.495 ************************************ 00:16:17.495 END TEST nvmf_fio_target 00:16:17.495 ************************************ 00:16:17.495 15:03:58 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:16:17.495 15:03:58 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:16:17.495 15:03:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:16:17.495 15:03:58 -- common/autotest_common.sh@10 -- # set +x 00:16:17.756 ************************************ 00:16:17.756 START TEST nvmf_bdevio 00:16:17.756 ************************************ 00:16:17.756 15:03:58 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:16:17.756 * Looking for test storage... 00:16:17.756 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:17.756 15:03:58 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:17.756 15:03:58 -- nvmf/common.sh@7 -- # uname -s 00:16:17.756 15:03:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:17.756 15:03:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:17.756 15:03:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:17.756 15:03:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:17.756 15:03:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:17.756 15:03:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:17.756 15:03:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:17.756 15:03:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:17.756 15:03:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:17.756 15:03:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:17.756 15:03:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:17.757 15:03:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:17.757 15:03:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:17.757 15:03:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:17.757 15:03:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:17.757 15:03:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:17.757 15:03:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:17.757 15:03:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:17.757 15:03:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:17.757 15:03:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:17.757 15:03:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.757 15:03:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.757 15:03:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.757 15:03:58 -- paths/export.sh@5 -- # export PATH 00:16:17.757 15:03:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:17.757 15:03:58 -- nvmf/common.sh@47 -- # : 0 00:16:17.757 15:03:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:17.757 15:03:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:17.757 15:03:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:17.757 15:03:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:17.757 15:03:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:17.757 15:03:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:17.757 15:03:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:17.757 15:03:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:17.757 15:03:58 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:17.757 15:03:58 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:17.757 15:03:58 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:17.757 15:03:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:17.757 15:03:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:17.757 15:03:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:17.757 15:03:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:17.757 15:03:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:17.757 15:03:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:17.757 15:03:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:17.757 15:03:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:17.757 15:03:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:17.757 15:03:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:17.757 15:03:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:17.757 15:03:58 -- common/autotest_common.sh@10 -- # set +x 00:16:24.345 15:04:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:24.345 15:04:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:24.345 15:04:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:24.345 15:04:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:24.345 15:04:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:24.345 15:04:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:24.345 15:04:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:24.345 15:04:04 -- nvmf/common.sh@295 -- # net_devs=() 00:16:24.345 15:04:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:24.345 15:04:04 -- nvmf/common.sh@296 -- # e810=() 00:16:24.345 15:04:04 -- nvmf/common.sh@296 -- # local -ga e810 00:16:24.345 15:04:04 -- nvmf/common.sh@297 -- # x722=() 00:16:24.345 15:04:04 -- nvmf/common.sh@297 -- # local -ga x722 00:16:24.345 15:04:04 -- nvmf/common.sh@298 -- # mlx=() 00:16:24.345 15:04:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:24.345 15:04:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:24.345 15:04:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:24.345 15:04:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:24.345 15:04:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:16:24.345 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:16:24.345 15:04:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:24.345 15:04:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:24.345 15:04:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:16:24.345 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:16:24.345 15:04:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:24.345 15:04:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:24.345 15:04:04 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:24.345 15:04:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:24.345 15:04:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:24.345 15:04:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:24.345 15:04:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:16:24.345 Found net devices under 0000:31:00.0: mlx_0_0 00:16:24.345 15:04:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:24.345 15:04:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:24.345 15:04:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:24.345 15:04:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:24.345 15:04:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:16:24.345 Found net devices under 0000:31:00.1: mlx_0_1 00:16:24.345 15:04:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:24.345 15:04:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:24.345 15:04:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:24.345 15:04:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:24.345 15:04:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:24.345 15:04:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:24.345 15:04:04 -- nvmf/common.sh@58 -- # uname 00:16:24.345 15:04:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:24.346 15:04:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:24.346 15:04:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:24.346 15:04:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:24.346 15:04:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:24.346 15:04:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:24.346 15:04:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:24.346 15:04:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:24.346 15:04:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:24.346 15:04:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:24.346 15:04:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:24.346 15:04:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:24.346 15:04:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:24.346 15:04:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:24.346 15:04:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:24.346 15:04:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:24.346 15:04:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@105 -- # continue 2 00:16:24.346 15:04:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@105 -- # continue 2 00:16:24.346 15:04:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:24.346 15:04:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.346 15:04:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:24.346 15:04:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:24.346 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:24.346 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:16:24.346 altname enp49s0f0np0 00:16:24.346 altname ens786f0np0 00:16:24.346 inet 192.168.100.8/24 scope global mlx_0_0 00:16:24.346 valid_lft forever preferred_lft forever 00:16:24.346 15:04:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:24.346 15:04:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.346 15:04:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:24.346 15:04:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:24.346 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:24.346 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:16:24.346 altname enp49s0f1np1 00:16:24.346 altname ens786f1np1 00:16:24.346 inet 192.168.100.9/24 scope global mlx_0_1 00:16:24.346 valid_lft forever preferred_lft forever 00:16:24.346 15:04:04 -- nvmf/common.sh@411 -- # return 0 00:16:24.346 15:04:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:24.346 15:04:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:24.346 15:04:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:24.346 15:04:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:24.346 15:04:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:24.346 15:04:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:24.346 15:04:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:24.346 15:04:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:24.346 15:04:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:24.346 15:04:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@105 -- # continue 2 00:16:24.346 15:04:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.346 15:04:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:24.346 15:04:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@105 -- # continue 2 00:16:24.346 15:04:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:24.346 15:04:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.346 15:04:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:24.346 15:04:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.346 15:04:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.346 15:04:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:24.346 192.168.100.9' 00:16:24.346 15:04:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:24.346 192.168.100.9' 00:16:24.346 15:04:04 -- nvmf/common.sh@446 -- # head -n 1 00:16:24.346 15:04:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:24.346 15:04:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:24.346 192.168.100.9' 00:16:24.346 15:04:04 -- nvmf/common.sh@447 -- # tail -n +2 00:16:24.346 15:04:04 -- nvmf/common.sh@447 -- # head -n 1 00:16:24.346 15:04:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:24.346 15:04:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:24.346 15:04:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:24.346 15:04:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:24.346 15:04:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:24.346 15:04:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:24.346 15:04:04 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:24.346 15:04:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:24.346 15:04:04 -- common/autotest_common.sh@720 -- # xtrace_disable 00:16:24.346 15:04:04 -- common/autotest_common.sh@10 -- # set +x 00:16:24.346 15:04:05 -- nvmf/common.sh@470 -- # nvmfpid=3513188 00:16:24.346 15:04:05 -- nvmf/common.sh@471 -- # waitforlisten 3513188 00:16:24.346 15:04:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:24.346 15:04:05 -- common/autotest_common.sh@827 -- # '[' -z 3513188 ']' 00:16:24.346 15:04:05 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:24.346 15:04:05 -- common/autotest_common.sh@832 -- # local max_retries=100 00:16:24.346 15:04:05 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:24.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:24.346 15:04:05 -- common/autotest_common.sh@836 -- # xtrace_disable 00:16:24.346 15:04:05 -- common/autotest_common.sh@10 -- # set +x 00:16:24.346 [2024-04-26 15:04:05.048783] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:16:24.346 [2024-04-26 15:04:05.048834] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:24.346 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.346 [2024-04-26 15:04:05.108495] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:24.346 [2024-04-26 15:04:05.172012] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:24.346 [2024-04-26 15:04:05.172054] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:24.346 [2024-04-26 15:04:05.172063] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:24.346 [2024-04-26 15:04:05.172071] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:24.346 [2024-04-26 15:04:05.172078] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:24.346 [2024-04-26 15:04:05.172228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:24.346 [2024-04-26 15:04:05.172379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:24.346 [2024-04-26 15:04:05.172529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:24.346 [2024-04-26 15:04:05.172529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:24.918 15:04:05 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:16:24.918 15:04:05 -- common/autotest_common.sh@860 -- # return 0 00:16:24.918 15:04:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:24.918 15:04:05 -- common/autotest_common.sh@726 -- # xtrace_disable 00:16:24.918 15:04:05 -- common/autotest_common.sh@10 -- # set +x 00:16:24.918 15:04:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:24.918 15:04:05 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:24.918 15:04:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.918 15:04:05 -- common/autotest_common.sh@10 -- # set +x 00:16:25.180 [2024-04-26 15:04:05.900247] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1538410/0x153c900) succeed. 00:16:25.180 [2024-04-26 15:04:05.915274] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1539a50/0x157df90) succeed. 00:16:25.180 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.180 15:04:06 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:25.180 15:04:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:25.180 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:25.180 Malloc0 00:16:25.180 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.180 15:04:06 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:25.180 15:04:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:25.180 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:25.180 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.180 15:04:06 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:25.180 15:04:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:25.180 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:25.180 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.180 15:04:06 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:25.180 15:04:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:25.180 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:25.180 [2024-04-26 15:04:06.081008] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:25.180 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.180 15:04:06 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:25.180 15:04:06 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:25.180 15:04:06 -- nvmf/common.sh@521 -- # config=() 00:16:25.180 15:04:06 -- nvmf/common.sh@521 -- # local subsystem config 00:16:25.180 15:04:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:25.180 15:04:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:25.180 { 00:16:25.180 "params": { 00:16:25.180 "name": "Nvme$subsystem", 00:16:25.180 "trtype": "$TEST_TRANSPORT", 00:16:25.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:25.180 "adrfam": "ipv4", 00:16:25.180 "trsvcid": "$NVMF_PORT", 00:16:25.180 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:25.180 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:25.180 "hdgst": ${hdgst:-false}, 00:16:25.180 "ddgst": ${ddgst:-false} 00:16:25.180 }, 00:16:25.180 "method": "bdev_nvme_attach_controller" 00:16:25.180 } 00:16:25.180 EOF 00:16:25.180 )") 00:16:25.180 15:04:06 -- nvmf/common.sh@543 -- # cat 00:16:25.180 15:04:06 -- nvmf/common.sh@545 -- # jq . 00:16:25.180 15:04:06 -- nvmf/common.sh@546 -- # IFS=, 00:16:25.180 15:04:06 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:25.180 "params": { 00:16:25.180 "name": "Nvme1", 00:16:25.180 "trtype": "rdma", 00:16:25.180 "traddr": "192.168.100.8", 00:16:25.180 "adrfam": "ipv4", 00:16:25.180 "trsvcid": "4420", 00:16:25.180 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:25.180 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:25.180 "hdgst": false, 00:16:25.180 "ddgst": false 00:16:25.180 }, 00:16:25.180 "method": "bdev_nvme_attach_controller" 00:16:25.180 }' 00:16:25.180 [2024-04-26 15:04:06.105095] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:16:25.180 [2024-04-26 15:04:06.105133] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3513330 ] 00:16:25.180 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.441 [2024-04-26 15:04:06.156812] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:25.441 [2024-04-26 15:04:06.220897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:25.441 [2024-04-26 15:04:06.221019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:25.441 [2024-04-26 15:04:06.221023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:25.701 I/O targets: 00:16:25.701 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:25.701 00:16:25.701 00:16:25.701 CUnit - A unit testing framework for C - Version 2.1-3 00:16:25.701 http://cunit.sourceforge.net/ 00:16:25.701 00:16:25.701 00:16:25.701 Suite: bdevio tests on: Nvme1n1 00:16:25.701 Test: blockdev write read block ...passed 00:16:25.701 Test: blockdev write zeroes read block ...passed 00:16:25.701 Test: blockdev write zeroes read no split ...passed 00:16:25.701 Test: blockdev write zeroes read split ...passed 00:16:25.701 Test: blockdev write zeroes read split partial ...passed 00:16:25.702 Test: blockdev reset ...[2024-04-26 15:04:06.430117] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:25.702 [2024-04-26 15:04:06.457560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:25.702 [2024-04-26 15:04:06.491374] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:25.702 passed 00:16:25.702 Test: blockdev write read 8 blocks ...passed 00:16:25.702 Test: blockdev write read size > 128k ...passed 00:16:25.702 Test: blockdev write read invalid size ...passed 00:16:25.702 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:25.702 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:25.702 Test: blockdev write read max offset ...passed 00:16:25.702 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:25.702 Test: blockdev writev readv 8 blocks ...passed 00:16:25.702 Test: blockdev writev readv 30 x 1block ...passed 00:16:25.702 Test: blockdev writev readv block ...passed 00:16:25.702 Test: blockdev writev readv size > 128k ...passed 00:16:25.702 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:25.702 Test: blockdev comparev and writev ...[2024-04-26 15:04:06.495620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.495653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.495830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.495843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.495977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.495989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.495995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.496158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.496164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.496171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:25.702 [2024-04-26 15:04:06.496176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:25.702 passed 00:16:25.702 Test: blockdev nvme passthru rw ...passed 00:16:25.702 Test: blockdev nvme passthru vendor specific ...[2024-04-26 15:04:06.496812] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:25.702 [2024-04-26 15:04:06.496821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.496863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:25.702 [2024-04-26 15:04:06.496869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.496915] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:25.702 [2024-04-26 15:04:06.496922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:25.702 [2024-04-26 15:04:06.496970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:16:25.702 [2024-04-26 15:04:06.496977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:25.702 passed 00:16:25.702 Test: blockdev nvme admin passthru ...passed 00:16:25.702 Test: blockdev copy ...passed 00:16:25.702 00:16:25.702 Run Summary: Type Total Ran Passed Failed Inactive 00:16:25.702 suites 1 1 n/a 0 0 00:16:25.702 tests 23 23 23 0 0 00:16:25.702 asserts 152 152 152 0 n/a 00:16:25.702 00:16:25.702 Elapsed time = 0.212 seconds 00:16:25.702 15:04:06 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:25.702 15:04:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:25.702 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:25.962 15:04:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:25.962 15:04:06 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:25.962 15:04:06 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:25.962 15:04:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:25.962 15:04:06 -- nvmf/common.sh@117 -- # sync 00:16:25.962 15:04:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:25.962 15:04:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:25.962 15:04:06 -- nvmf/common.sh@120 -- # set +e 00:16:25.962 15:04:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:25.962 15:04:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:25.962 rmmod nvme_rdma 00:16:25.962 rmmod nvme_fabrics 00:16:25.962 15:04:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:25.962 15:04:06 -- nvmf/common.sh@124 -- # set -e 00:16:25.962 15:04:06 -- nvmf/common.sh@125 -- # return 0 00:16:25.962 15:04:06 -- nvmf/common.sh@478 -- # '[' -n 3513188 ']' 00:16:25.962 15:04:06 -- nvmf/common.sh@479 -- # killprocess 3513188 00:16:25.962 15:04:06 -- common/autotest_common.sh@946 -- # '[' -z 3513188 ']' 00:16:25.962 15:04:06 -- common/autotest_common.sh@950 -- # kill -0 3513188 00:16:25.962 15:04:06 -- common/autotest_common.sh@951 -- # uname 00:16:25.962 15:04:06 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:16:25.962 15:04:06 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3513188 00:16:25.962 15:04:06 -- common/autotest_common.sh@952 -- # process_name=reactor_3 00:16:25.962 15:04:06 -- common/autotest_common.sh@956 -- # '[' reactor_3 = sudo ']' 00:16:25.962 15:04:06 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3513188' 00:16:25.962 killing process with pid 3513188 00:16:25.962 15:04:06 -- common/autotest_common.sh@965 -- # kill 3513188 00:16:25.962 15:04:06 -- common/autotest_common.sh@970 -- # wait 3513188 00:16:25.962 [2024-04-26 15:04:06.836653] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:26.223 15:04:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:26.223 15:04:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:26.223 00:16:26.223 real 0m8.520s 00:16:26.223 user 0m9.956s 00:16:26.223 sys 0m5.306s 00:16:26.223 15:04:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:16:26.223 15:04:06 -- common/autotest_common.sh@10 -- # set +x 00:16:26.223 ************************************ 00:16:26.223 END TEST nvmf_bdevio 00:16:26.223 ************************************ 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:16:26.223 15:04:07 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:16:26.223 15:04:07 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:16:26.223 15:04:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:16:26.223 15:04:07 -- common/autotest_common.sh@10 -- # set +x 00:16:26.223 ************************************ 00:16:26.223 START TEST nvmf_device_removal 00:16:26.223 ************************************ 00:16:26.223 15:04:07 -- common/autotest_common.sh@1121 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:16:26.487 * Looking for test storage... 00:16:26.487 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.487 15:04:07 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:16:26.487 15:04:07 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:16:26.487 15:04:07 -- common/autotest_common.sh@34 -- # set -e 00:16:26.487 15:04:07 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:16:26.487 15:04:07 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:16:26.487 15:04:07 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:16:26.487 15:04:07 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:16:26.487 15:04:07 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:16:26.487 15:04:07 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:16:26.487 15:04:07 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:16:26.487 15:04:07 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:16:26.487 15:04:07 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:16:26.487 15:04:07 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:16:26.487 15:04:07 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:16:26.487 15:04:07 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:16:26.487 15:04:07 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:16:26.487 15:04:07 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:16:26.487 15:04:07 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:16:26.487 15:04:07 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:16:26.487 15:04:07 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:16:26.487 15:04:07 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:16:26.487 15:04:07 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:16:26.487 15:04:07 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:16:26.487 15:04:07 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:16:26.487 15:04:07 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:16:26.487 15:04:07 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:16:26.487 15:04:07 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:16:26.487 15:04:07 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:16:26.487 15:04:07 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:16:26.487 15:04:07 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:16:26.487 15:04:07 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:16:26.487 15:04:07 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:16:26.487 15:04:07 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:16:26.487 15:04:07 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:16:26.487 15:04:07 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:16:26.487 15:04:07 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:16:26.487 15:04:07 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:16:26.487 15:04:07 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:16:26.487 15:04:07 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:16:26.487 15:04:07 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:16:26.487 15:04:07 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:16:26.487 15:04:07 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:16:26.487 15:04:07 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:16:26.487 15:04:07 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:16:26.487 15:04:07 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:16:26.487 15:04:07 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:16:26.487 15:04:07 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:16:26.487 15:04:07 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:16:26.487 15:04:07 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:16:26.487 15:04:07 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:16:26.487 15:04:07 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:16:26.487 15:04:07 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:16:26.487 15:04:07 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:16:26.487 15:04:07 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:16:26.487 15:04:07 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:16:26.487 15:04:07 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:16:26.487 15:04:07 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:16:26.487 15:04:07 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:16:26.487 15:04:07 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:16:26.487 15:04:07 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:16:26.487 15:04:07 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:16:26.487 15:04:07 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:16:26.487 15:04:07 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:16:26.487 15:04:07 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:16:26.487 15:04:07 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:16:26.487 15:04:07 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:16:26.488 15:04:07 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:16:26.488 15:04:07 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:16:26.488 15:04:07 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:16:26.488 15:04:07 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:16:26.488 15:04:07 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:16:26.488 15:04:07 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:16:26.488 15:04:07 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:16:26.488 15:04:07 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:16:26.488 15:04:07 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:16:26.488 15:04:07 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:16:26.488 15:04:07 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:16:26.488 15:04:07 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:16:26.488 15:04:07 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:16:26.488 15:04:07 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:16:26.488 15:04:07 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:16:26.488 15:04:07 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:16:26.488 15:04:07 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:16:26.488 15:04:07 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:16:26.488 15:04:07 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:16:26.488 15:04:07 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:16:26.488 15:04:07 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:16:26.488 15:04:07 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:16:26.488 15:04:07 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:16:26.488 15:04:07 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:26.488 15:04:07 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:16:26.488 15:04:07 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:26.488 15:04:07 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:16:26.488 15:04:07 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:16:26.488 15:04:07 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:16:26.488 15:04:07 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:16:26.488 15:04:07 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:16:26.488 15:04:07 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:16:26.488 15:04:07 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:16:26.488 15:04:07 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:16:26.488 #define SPDK_CONFIG_H 00:16:26.488 #define SPDK_CONFIG_APPS 1 00:16:26.488 #define SPDK_CONFIG_ARCH native 00:16:26.488 #undef SPDK_CONFIG_ASAN 00:16:26.488 #undef SPDK_CONFIG_AVAHI 00:16:26.488 #undef SPDK_CONFIG_CET 00:16:26.488 #define SPDK_CONFIG_COVERAGE 1 00:16:26.488 #define SPDK_CONFIG_CROSS_PREFIX 00:16:26.488 #undef SPDK_CONFIG_CRYPTO 00:16:26.488 #undef SPDK_CONFIG_CRYPTO_MLX5 00:16:26.488 #undef SPDK_CONFIG_CUSTOMOCF 00:16:26.488 #undef SPDK_CONFIG_DAOS 00:16:26.488 #define SPDK_CONFIG_DAOS_DIR 00:16:26.488 #define SPDK_CONFIG_DEBUG 1 00:16:26.488 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:16:26.488 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:16:26.488 #define SPDK_CONFIG_DPDK_INC_DIR 00:16:26.488 #define SPDK_CONFIG_DPDK_LIB_DIR 00:16:26.488 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:16:26.488 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:16:26.488 #define SPDK_CONFIG_EXAMPLES 1 00:16:26.488 #undef SPDK_CONFIG_FC 00:16:26.488 #define SPDK_CONFIG_FC_PATH 00:16:26.488 #define SPDK_CONFIG_FIO_PLUGIN 1 00:16:26.488 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:16:26.488 #undef SPDK_CONFIG_FUSE 00:16:26.488 #undef SPDK_CONFIG_FUZZER 00:16:26.488 #define SPDK_CONFIG_FUZZER_LIB 00:16:26.488 #undef SPDK_CONFIG_GOLANG 00:16:26.488 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:16:26.488 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:16:26.488 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:16:26.488 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:16:26.488 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:16:26.488 #undef SPDK_CONFIG_HAVE_LIBBSD 00:16:26.488 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:16:26.488 #define SPDK_CONFIG_IDXD 1 00:16:26.488 #undef SPDK_CONFIG_IDXD_KERNEL 00:16:26.488 #undef SPDK_CONFIG_IPSEC_MB 00:16:26.488 #define SPDK_CONFIG_IPSEC_MB_DIR 00:16:26.488 #define SPDK_CONFIG_ISAL 1 00:16:26.488 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:16:26.488 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:16:26.488 #define SPDK_CONFIG_LIBDIR 00:16:26.488 #undef SPDK_CONFIG_LTO 00:16:26.488 #define SPDK_CONFIG_MAX_LCORES 00:16:26.488 #define SPDK_CONFIG_NVME_CUSE 1 00:16:26.488 #undef SPDK_CONFIG_OCF 00:16:26.488 #define SPDK_CONFIG_OCF_PATH 00:16:26.488 #define SPDK_CONFIG_OPENSSL_PATH 00:16:26.488 #undef SPDK_CONFIG_PGO_CAPTURE 00:16:26.488 #define SPDK_CONFIG_PGO_DIR 00:16:26.488 #undef SPDK_CONFIG_PGO_USE 00:16:26.488 #define SPDK_CONFIG_PREFIX /usr/local 00:16:26.488 #undef SPDK_CONFIG_RAID5F 00:16:26.488 #undef SPDK_CONFIG_RBD 00:16:26.488 #define SPDK_CONFIG_RDMA 1 00:16:26.488 #define SPDK_CONFIG_RDMA_PROV verbs 00:16:26.488 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:16:26.488 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:16:26.488 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:16:26.488 #define SPDK_CONFIG_SHARED 1 00:16:26.488 #undef SPDK_CONFIG_SMA 00:16:26.488 #define SPDK_CONFIG_TESTS 1 00:16:26.488 #undef SPDK_CONFIG_TSAN 00:16:26.488 #define SPDK_CONFIG_UBLK 1 00:16:26.488 #define SPDK_CONFIG_UBSAN 1 00:16:26.488 #undef SPDK_CONFIG_UNIT_TESTS 00:16:26.488 #undef SPDK_CONFIG_URING 00:16:26.488 #define SPDK_CONFIG_URING_PATH 00:16:26.488 #undef SPDK_CONFIG_URING_ZNS 00:16:26.488 #undef SPDK_CONFIG_USDT 00:16:26.488 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:16:26.488 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:16:26.488 #undef SPDK_CONFIG_VFIO_USER 00:16:26.488 #define SPDK_CONFIG_VFIO_USER_DIR 00:16:26.488 #define SPDK_CONFIG_VHOST 1 00:16:26.488 #define SPDK_CONFIG_VIRTIO 1 00:16:26.488 #undef SPDK_CONFIG_VTUNE 00:16:26.488 #define SPDK_CONFIG_VTUNE_DIR 00:16:26.488 #define SPDK_CONFIG_WERROR 1 00:16:26.488 #define SPDK_CONFIG_WPDK_DIR 00:16:26.488 #undef SPDK_CONFIG_XNVME 00:16:26.488 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:16:26.488 15:04:07 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:16:26.488 15:04:07 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:26.488 15:04:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.488 15:04:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.488 15:04:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.488 15:04:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.488 15:04:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.488 15:04:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.488 15:04:07 -- paths/export.sh@5 -- # export PATH 00:16:26.488 15:04:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.488 15:04:07 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:16:26.488 15:04:07 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:16:26.488 15:04:07 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:16:26.488 15:04:07 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:16:26.488 15:04:07 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:16:26.488 15:04:07 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:16:26.488 15:04:07 -- pm/common@67 -- # TEST_TAG=N/A 00:16:26.488 15:04:07 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:16:26.488 15:04:07 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:16:26.488 15:04:07 -- pm/common@71 -- # uname -s 00:16:26.488 15:04:07 -- pm/common@71 -- # PM_OS=Linux 00:16:26.488 15:04:07 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:16:26.488 15:04:07 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:16:26.488 15:04:07 -- pm/common@76 -- # [[ Linux == Linux ]] 00:16:26.488 15:04:07 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:16:26.488 15:04:07 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:16:26.488 15:04:07 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:16:26.488 15:04:07 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:16:26.488 15:04:07 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:16:26.488 15:04:07 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:16:26.488 15:04:07 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:16:26.488 15:04:07 -- common/autotest_common.sh@57 -- # : 0 00:16:26.488 15:04:07 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:16:26.488 15:04:07 -- common/autotest_common.sh@61 -- # : 0 00:16:26.488 15:04:07 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:16:26.489 15:04:07 -- common/autotest_common.sh@63 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:16:26.489 15:04:07 -- common/autotest_common.sh@65 -- # : 1 00:16:26.489 15:04:07 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:16:26.489 15:04:07 -- common/autotest_common.sh@67 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:16:26.489 15:04:07 -- common/autotest_common.sh@69 -- # : 00:16:26.489 15:04:07 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:16:26.489 15:04:07 -- common/autotest_common.sh@71 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:16:26.489 15:04:07 -- common/autotest_common.sh@73 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:16:26.489 15:04:07 -- common/autotest_common.sh@75 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:16:26.489 15:04:07 -- common/autotest_common.sh@77 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:16:26.489 15:04:07 -- common/autotest_common.sh@79 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:16:26.489 15:04:07 -- common/autotest_common.sh@81 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:16:26.489 15:04:07 -- common/autotest_common.sh@83 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:16:26.489 15:04:07 -- common/autotest_common.sh@85 -- # : 1 00:16:26.489 15:04:07 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:16:26.489 15:04:07 -- common/autotest_common.sh@87 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:16:26.489 15:04:07 -- common/autotest_common.sh@89 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:16:26.489 15:04:07 -- common/autotest_common.sh@91 -- # : 1 00:16:26.489 15:04:07 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:16:26.489 15:04:07 -- common/autotest_common.sh@93 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:16:26.489 15:04:07 -- common/autotest_common.sh@95 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:16:26.489 15:04:07 -- common/autotest_common.sh@97 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:16:26.489 15:04:07 -- common/autotest_common.sh@99 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:16:26.489 15:04:07 -- common/autotest_common.sh@101 -- # : rdma 00:16:26.489 15:04:07 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:16:26.489 15:04:07 -- common/autotest_common.sh@103 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:16:26.489 15:04:07 -- common/autotest_common.sh@105 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:16:26.489 15:04:07 -- common/autotest_common.sh@107 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:16:26.489 15:04:07 -- common/autotest_common.sh@109 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:16:26.489 15:04:07 -- common/autotest_common.sh@111 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:16:26.489 15:04:07 -- common/autotest_common.sh@113 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:16:26.489 15:04:07 -- common/autotest_common.sh@115 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:16:26.489 15:04:07 -- common/autotest_common.sh@117 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:16:26.489 15:04:07 -- common/autotest_common.sh@119 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:16:26.489 15:04:07 -- common/autotest_common.sh@121 -- # : 1 00:16:26.489 15:04:07 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:16:26.489 15:04:07 -- common/autotest_common.sh@123 -- # : 00:16:26.489 15:04:07 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:16:26.489 15:04:07 -- common/autotest_common.sh@125 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:16:26.489 15:04:07 -- common/autotest_common.sh@127 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:16:26.489 15:04:07 -- common/autotest_common.sh@129 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:16:26.489 15:04:07 -- common/autotest_common.sh@131 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:16:26.489 15:04:07 -- common/autotest_common.sh@133 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:16:26.489 15:04:07 -- common/autotest_common.sh@135 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:16:26.489 15:04:07 -- common/autotest_common.sh@137 -- # : 00:16:26.489 15:04:07 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:16:26.489 15:04:07 -- common/autotest_common.sh@139 -- # : true 00:16:26.489 15:04:07 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:16:26.489 15:04:07 -- common/autotest_common.sh@141 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:16:26.489 15:04:07 -- common/autotest_common.sh@143 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:16:26.489 15:04:07 -- common/autotest_common.sh@145 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:16:26.489 15:04:07 -- common/autotest_common.sh@147 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:16:26.489 15:04:07 -- common/autotest_common.sh@149 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:16:26.489 15:04:07 -- common/autotest_common.sh@151 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:16:26.489 15:04:07 -- common/autotest_common.sh@153 -- # : mlx5 00:16:26.489 15:04:07 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:16:26.489 15:04:07 -- common/autotest_common.sh@155 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:16:26.489 15:04:07 -- common/autotest_common.sh@157 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:16:26.489 15:04:07 -- common/autotest_common.sh@159 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:16:26.489 15:04:07 -- common/autotest_common.sh@161 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:16:26.489 15:04:07 -- common/autotest_common.sh@163 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:16:26.489 15:04:07 -- common/autotest_common.sh@166 -- # : 00:16:26.489 15:04:07 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:16:26.489 15:04:07 -- common/autotest_common.sh@168 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:16:26.489 15:04:07 -- common/autotest_common.sh@170 -- # : 0 00:16:26.489 15:04:07 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:16:26.489 15:04:07 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:16:26.489 15:04:07 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:16:26.489 15:04:07 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:16:26.489 15:04:07 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:16:26.489 15:04:07 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:16:26.489 15:04:07 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:16:26.489 15:04:07 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:16:26.489 15:04:07 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:16:26.489 15:04:07 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:16:26.490 15:04:07 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:16:26.490 15:04:07 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:16:26.490 15:04:07 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:16:26.490 15:04:07 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:16:26.490 15:04:07 -- common/autotest_common.sh@199 -- # cat 00:16:26.490 15:04:07 -- common/autotest_common.sh@235 -- # echo leak:libfuse3.so 00:16:26.490 15:04:07 -- common/autotest_common.sh@237 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:16:26.490 15:04:07 -- common/autotest_common.sh@237 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:16:26.490 15:04:07 -- common/autotest_common.sh@239 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:16:26.490 15:04:07 -- common/autotest_common.sh@239 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:16:26.490 15:04:07 -- common/autotest_common.sh@241 -- # '[' -z /var/spdk/dependencies ']' 00:16:26.490 15:04:07 -- common/autotest_common.sh@244 -- # export DEPENDENCY_DIR 00:16:26.490 15:04:07 -- common/autotest_common.sh@248 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:26.490 15:04:07 -- common/autotest_common.sh@248 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:16:26.490 15:04:07 -- common/autotest_common.sh@249 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:26.490 15:04:07 -- common/autotest_common.sh@249 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:16:26.490 15:04:07 -- common/autotest_common.sh@252 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:16:26.490 15:04:07 -- common/autotest_common.sh@252 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:16:26.490 15:04:07 -- common/autotest_common.sh@253 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:16:26.490 15:04:07 -- common/autotest_common.sh@253 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:16:26.490 15:04:07 -- common/autotest_common.sh@255 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:16:26.490 15:04:07 -- common/autotest_common.sh@255 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:16:26.490 15:04:07 -- common/autotest_common.sh@258 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:16:26.490 15:04:07 -- common/autotest_common.sh@258 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:16:26.490 15:04:07 -- common/autotest_common.sh@261 -- # '[' 0 -eq 0 ']' 00:16:26.490 15:04:07 -- common/autotest_common.sh@262 -- # export valgrind= 00:16:26.490 15:04:07 -- common/autotest_common.sh@262 -- # valgrind= 00:16:26.490 15:04:07 -- common/autotest_common.sh@268 -- # uname -s 00:16:26.490 15:04:07 -- common/autotest_common.sh@268 -- # '[' Linux = Linux ']' 00:16:26.490 15:04:07 -- common/autotest_common.sh@269 -- # HUGEMEM=4096 00:16:26.490 15:04:07 -- common/autotest_common.sh@270 -- # export CLEAR_HUGE=yes 00:16:26.490 15:04:07 -- common/autotest_common.sh@270 -- # CLEAR_HUGE=yes 00:16:26.490 15:04:07 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@278 -- # MAKE=make 00:16:26.490 15:04:07 -- common/autotest_common.sh@279 -- # MAKEFLAGS=-j144 00:16:26.490 15:04:07 -- common/autotest_common.sh@295 -- # export HUGEMEM=4096 00:16:26.490 15:04:07 -- common/autotest_common.sh@295 -- # HUGEMEM=4096 00:16:26.490 15:04:07 -- common/autotest_common.sh@297 -- # NO_HUGE=() 00:16:26.490 15:04:07 -- common/autotest_common.sh@298 -- # TEST_MODE= 00:16:26.490 15:04:07 -- common/autotest_common.sh@299 -- # for i in "$@" 00:16:26.490 15:04:07 -- common/autotest_common.sh@300 -- # case "$i" in 00:16:26.490 15:04:07 -- common/autotest_common.sh@305 -- # TEST_TRANSPORT=rdma 00:16:26.490 15:04:07 -- common/autotest_common.sh@317 -- # [[ -z 3513607 ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@317 -- # kill -0 3513607 00:16:26.490 15:04:07 -- common/autotest_common.sh@1676 -- # set_test_storage 2147483648 00:16:26.490 15:04:07 -- common/autotest_common.sh@327 -- # [[ -v testdir ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@329 -- # local requested_size=2147483648 00:16:26.490 15:04:07 -- common/autotest_common.sh@330 -- # local mount target_dir 00:16:26.490 15:04:07 -- common/autotest_common.sh@332 -- # local -A mounts fss sizes avails uses 00:16:26.490 15:04:07 -- common/autotest_common.sh@333 -- # local source fs size avail mount use 00:16:26.490 15:04:07 -- common/autotest_common.sh@335 -- # local storage_fallback storage_candidates 00:16:26.490 15:04:07 -- common/autotest_common.sh@337 -- # mktemp -udt spdk.XXXXXX 00:16:26.490 15:04:07 -- common/autotest_common.sh@337 -- # storage_fallback=/tmp/spdk.H6fgvH 00:16:26.490 15:04:07 -- common/autotest_common.sh@342 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:16:26.490 15:04:07 -- common/autotest_common.sh@344 -- # [[ -n '' ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@349 -- # [[ -n '' ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@354 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.H6fgvH/tests/target /tmp/spdk.H6fgvH 00:16:26.490 15:04:07 -- common/autotest_common.sh@357 -- # requested_size=2214592512 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@326 -- # df -T 00:16:26.490 15:04:07 -- common/autotest_common.sh@326 -- # grep -v Filesystem 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_devtmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=devtmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=67108864 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=67108864 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=0 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/pmem0 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=ext2 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=1052192768 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=5284429824 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=4232237056 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_root 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=overlay 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=115706974208 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=129371037696 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=13664063488 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=64677179392 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=64685518848 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=8339456 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=25850855424 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=25874210816 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=23355392 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=efivarfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=efivarfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=234496 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=507904 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=269312 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=64684515328 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=64685518848 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=1003520 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # avails["$mount"]=12937097216 00:16:26.490 15:04:07 -- common/autotest_common.sh@361 -- # sizes["$mount"]=12937101312 00:16:26.490 15:04:07 -- common/autotest_common.sh@362 -- # uses["$mount"]=4096 00:16:26.490 15:04:07 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:16:26.490 15:04:07 -- common/autotest_common.sh@365 -- # printf '* Looking for test storage...\n' 00:16:26.490 * Looking for test storage... 00:16:26.490 15:04:07 -- common/autotest_common.sh@367 -- # local target_space new_size 00:16:26.490 15:04:07 -- common/autotest_common.sh@368 -- # for target_dir in "${storage_candidates[@]}" 00:16:26.490 15:04:07 -- common/autotest_common.sh@371 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.490 15:04:07 -- common/autotest_common.sh@371 -- # awk '$1 !~ /Filesystem/{print $6}' 00:16:26.490 15:04:07 -- common/autotest_common.sh@371 -- # mount=/ 00:16:26.490 15:04:07 -- common/autotest_common.sh@373 -- # target_space=115706974208 00:16:26.490 15:04:07 -- common/autotest_common.sh@374 -- # (( target_space == 0 || target_space < requested_size )) 00:16:26.490 15:04:07 -- common/autotest_common.sh@377 -- # (( target_space >= requested_size )) 00:16:26.490 15:04:07 -- common/autotest_common.sh@379 -- # [[ overlay == tmpfs ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@379 -- # [[ overlay == ramfs ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@379 -- # [[ / == / ]] 00:16:26.490 15:04:07 -- common/autotest_common.sh@380 -- # new_size=15878656000 00:16:26.490 15:04:07 -- common/autotest_common.sh@381 -- # (( new_size * 100 / sizes[/] > 95 )) 00:16:26.490 15:04:07 -- common/autotest_common.sh@386 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.490 15:04:07 -- common/autotest_common.sh@386 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.490 15:04:07 -- common/autotest_common.sh@387 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.490 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:26.490 15:04:07 -- common/autotest_common.sh@388 -- # return 0 00:16:26.490 15:04:07 -- common/autotest_common.sh@1678 -- # set -o errtrace 00:16:26.490 15:04:07 -- common/autotest_common.sh@1679 -- # shopt -s extdebug 00:16:26.491 15:04:07 -- common/autotest_common.sh@1680 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:16:26.491 15:04:07 -- common/autotest_common.sh@1682 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:16:26.491 15:04:07 -- common/autotest_common.sh@1683 -- # true 00:16:26.491 15:04:07 -- common/autotest_common.sh@1685 -- # xtrace_fd 00:16:26.491 15:04:07 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:16:26.491 15:04:07 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:16:26.491 15:04:07 -- common/autotest_common.sh@27 -- # exec 00:16:26.491 15:04:07 -- common/autotest_common.sh@29 -- # exec 00:16:26.491 15:04:07 -- common/autotest_common.sh@31 -- # xtrace_restore 00:16:26.491 15:04:07 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:16:26.491 15:04:07 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:16:26.491 15:04:07 -- common/autotest_common.sh@18 -- # set -x 00:16:26.491 15:04:07 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.753 15:04:07 -- nvmf/common.sh@7 -- # uname -s 00:16:26.753 15:04:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.753 15:04:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.753 15:04:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.753 15:04:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.753 15:04:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.753 15:04:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.753 15:04:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.753 15:04:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.753 15:04:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.753 15:04:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.753 15:04:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:26.753 15:04:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:16:26.753 15:04:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.753 15:04:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.753 15:04:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.753 15:04:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:26.753 15:04:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:26.753 15:04:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.753 15:04:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.753 15:04:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.753 15:04:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.753 15:04:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.753 15:04:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.753 15:04:07 -- paths/export.sh@5 -- # export PATH 00:16:26.753 15:04:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.753 15:04:07 -- nvmf/common.sh@47 -- # : 0 00:16:26.753 15:04:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:26.753 15:04:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:26.753 15:04:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:26.753 15:04:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.753 15:04:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.753 15:04:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:26.753 15:04:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:26.753 15:04:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:26.753 15:04:07 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:16:26.753 15:04:07 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:16:26.753 15:04:07 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:26.753 15:04:07 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:16:26.753 15:04:07 -- target/device_removal.sh@18 -- # nvmftestinit 00:16:26.753 15:04:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:26.753 15:04:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.753 15:04:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:26.753 15:04:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:26.753 15:04:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:26.753 15:04:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.753 15:04:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.753 15:04:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.753 15:04:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:26.753 15:04:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:26.753 15:04:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:26.753 15:04:07 -- common/autotest_common.sh@10 -- # set +x 00:16:33.344 15:04:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:33.344 15:04:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:33.344 15:04:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:33.344 15:04:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:33.344 15:04:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:33.344 15:04:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:33.344 15:04:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:33.344 15:04:14 -- nvmf/common.sh@295 -- # net_devs=() 00:16:33.344 15:04:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:33.344 15:04:14 -- nvmf/common.sh@296 -- # e810=() 00:16:33.344 15:04:14 -- nvmf/common.sh@296 -- # local -ga e810 00:16:33.344 15:04:14 -- nvmf/common.sh@297 -- # x722=() 00:16:33.344 15:04:14 -- nvmf/common.sh@297 -- # local -ga x722 00:16:33.344 15:04:14 -- nvmf/common.sh@298 -- # mlx=() 00:16:33.344 15:04:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:33.344 15:04:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:33.344 15:04:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:33.344 15:04:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:33.344 15:04:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:16:33.344 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:16:33.344 15:04:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:33.344 15:04:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:33.344 15:04:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:16:33.344 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:16:33.344 15:04:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:33.344 15:04:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:33.344 15:04:14 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:33.344 15:04:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:33.344 15:04:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:33.344 15:04:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:33.344 15:04:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:16:33.344 Found net devices under 0000:31:00.0: mlx_0_0 00:16:33.344 15:04:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:33.344 15:04:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:33.344 15:04:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:33.344 15:04:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:33.344 15:04:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:16:33.344 Found net devices under 0000:31:00.1: mlx_0_1 00:16:33.344 15:04:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:33.344 15:04:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:33.344 15:04:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:33.344 15:04:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:33.344 15:04:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:33.344 15:04:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:33.344 15:04:14 -- nvmf/common.sh@58 -- # uname 00:16:33.344 15:04:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:33.344 15:04:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:33.344 15:04:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:33.344 15:04:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:33.344 15:04:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:33.344 15:04:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:33.344 15:04:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:33.605 15:04:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:33.605 15:04:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:33.605 15:04:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:33.606 15:04:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:33.606 15:04:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:33.606 15:04:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:33.606 15:04:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:33.606 15:04:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:33.606 15:04:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:33.606 15:04:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@105 -- # continue 2 00:16:33.606 15:04:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@105 -- # continue 2 00:16:33.606 15:04:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:33.606 15:04:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:33.606 15:04:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:33.606 15:04:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:33.606 142: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:33.606 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:16:33.606 altname enp49s0f0np0 00:16:33.606 altname ens786f0np0 00:16:33.606 inet 192.168.100.8/24 scope global mlx_0_0 00:16:33.606 valid_lft forever preferred_lft forever 00:16:33.606 15:04:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:33.606 15:04:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:33.606 15:04:14 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:33.606 15:04:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:33.606 143: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:33.606 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:16:33.606 altname enp49s0f1np1 00:16:33.606 altname ens786f1np1 00:16:33.606 inet 192.168.100.9/24 scope global mlx_0_1 00:16:33.606 valid_lft forever preferred_lft forever 00:16:33.606 15:04:14 -- nvmf/common.sh@411 -- # return 0 00:16:33.606 15:04:14 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:33.606 15:04:14 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:33.606 15:04:14 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:33.606 15:04:14 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:33.606 15:04:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:33.606 15:04:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:33.606 15:04:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:33.606 15:04:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:33.606 15:04:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:33.606 15:04:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@105 -- # continue 2 00:16:33.606 15:04:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:33.606 15:04:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:33.606 15:04:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@105 -- # continue 2 00:16:33.606 15:04:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:33.606 15:04:14 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:33.606 15:04:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:33.606 15:04:14 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:33.606 15:04:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:33.606 15:04:14 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:33.606 192.168.100.9' 00:16:33.606 15:04:14 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:33.606 192.168.100.9' 00:16:33.606 15:04:14 -- nvmf/common.sh@446 -- # head -n 1 00:16:33.606 15:04:14 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:33.606 15:04:14 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:33.606 192.168.100.9' 00:16:33.606 15:04:14 -- nvmf/common.sh@447 -- # tail -n +2 00:16:33.606 15:04:14 -- nvmf/common.sh@447 -- # head -n 1 00:16:33.606 15:04:14 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:33.606 15:04:14 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:33.606 15:04:14 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:33.606 15:04:14 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:33.606 15:04:14 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:33.606 15:04:14 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:33.606 15:04:14 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:16:33.606 15:04:14 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:16:33.606 15:04:14 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:16:33.606 15:04:14 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:16:33.606 15:04:14 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:16:33.606 15:04:14 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:16:33.606 15:04:14 -- common/autotest_common.sh@10 -- # set +x 00:16:33.868 ************************************ 00:16:33.868 START TEST nvmf_device_removal_pci_remove_no_srq 00:16:33.868 ************************************ 00:16:33.868 15:04:14 -- common/autotest_common.sh@1121 -- # test_remove_and_rescan --no-srq 00:16:33.868 15:04:14 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:16:33.868 15:04:14 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:33.868 15:04:14 -- common/autotest_common.sh@720 -- # xtrace_disable 00:16:33.868 15:04:14 -- common/autotest_common.sh@10 -- # set +x 00:16:33.868 15:04:14 -- nvmf/common.sh@470 -- # nvmfpid=3517306 00:16:33.868 15:04:14 -- nvmf/common.sh@471 -- # waitforlisten 3517306 00:16:33.868 15:04:14 -- common/autotest_common.sh@827 -- # '[' -z 3517306 ']' 00:16:33.868 15:04:14 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:33.868 15:04:14 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:33.868 15:04:14 -- common/autotest_common.sh@832 -- # local max_retries=100 00:16:33.868 15:04:14 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:33.868 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:33.868 15:04:14 -- common/autotest_common.sh@836 -- # xtrace_disable 00:16:33.868 15:04:14 -- common/autotest_common.sh@10 -- # set +x 00:16:33.868 [2024-04-26 15:04:14.709618] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:16:33.868 [2024-04-26 15:04:14.709679] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:33.868 EAL: No free 2048 kB hugepages reported on node 1 00:16:33.868 [2024-04-26 15:04:14.774559] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:34.129 [2024-04-26 15:04:14.847488] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:34.129 [2024-04-26 15:04:14.847526] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:34.129 [2024-04-26 15:04:14.847534] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:34.129 [2024-04-26 15:04:14.847540] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:34.129 [2024-04-26 15:04:14.847546] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:34.129 [2024-04-26 15:04:14.847654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:34.129 [2024-04-26 15:04:14.847660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:34.701 15:04:15 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:16:34.701 15:04:15 -- common/autotest_common.sh@860 -- # return 0 00:16:34.701 15:04:15 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:34.701 15:04:15 -- common/autotest_common.sh@726 -- # xtrace_disable 00:16:34.701 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.701 15:04:15 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:34.701 15:04:15 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:16:34.701 15:04:15 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:16:34.701 15:04:15 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:16:34.701 15:04:15 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:16:34.701 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.701 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.701 [2024-04-26 15:04:15.563786] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x179a540/0x179ea30) succeed. 00:16:34.701 [2024-04-26 15:04:15.575821] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x179ba40/0x17e00c0) succeed. 00:16:34.701 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.701 15:04:15 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:16:34.701 15:04:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:34.701 15:04:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:34.701 15:04:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:34.701 15:04:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:34.701 15:04:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:34.701 15:04:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:34.701 15:04:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:34.701 15:04:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:34.701 15:04:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:34.701 15:04:15 -- nvmf/common.sh@105 -- # continue 2 00:16:34.701 15:04:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:34.701 15:04:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:34.701 15:04:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:34.701 15:04:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:34.701 15:04:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:34.701 15:04:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:34.701 15:04:15 -- nvmf/common.sh@105 -- # continue 2 00:16:34.701 15:04:15 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:34.701 15:04:15 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:34.701 15:04:15 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:16:34.701 15:04:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:34.701 15:04:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:34.701 15:04:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:34.701 15:04:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:34.701 15:04:15 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:16:34.701 15:04:15 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:16:34.701 15:04:15 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:34.701 15:04:15 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:34.701 15:04:15 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:16:34.701 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.701 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 [2024-04-26 15:04:15.697798] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@41 -- # return 0 00:16:34.962 15:04:15 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:16:34.962 15:04:15 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:34.962 15:04:15 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:34.962 15:04:15 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:16:34.962 15:04:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:34.962 15:04:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:34.962 15:04:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:34.962 15:04:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:34.962 15:04:15 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:16:34.962 15:04:15 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:16:34.962 15:04:15 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:34.962 15:04:15 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:34.962 15:04:15 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.962 15:04:15 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:16:34.962 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.962 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.962 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.963 15:04:15 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:16:34.963 15:04:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.963 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:34.963 [2024-04-26 15:04:15.770531] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:34.963 15:04:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.963 15:04:15 -- target/device_removal.sh@41 -- # return 0 00:16:34.963 15:04:15 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:16:34.963 15:04:15 -- target/device_removal.sh@53 -- # return 0 00:16:34.963 15:04:15 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:16:34.963 15:04:15 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:16:34.963 15:04:15 -- target/device_removal.sh@87 -- # local dev_names 00:16:34.963 15:04:15 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:34.963 15:04:15 -- target/device_removal.sh@91 -- # bdevperf_pid=3517623 00:16:34.963 15:04:15 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:34.963 15:04:15 -- target/device_removal.sh@94 -- # waitforlisten 3517623 /var/tmp/bdevperf.sock 00:16:34.963 15:04:15 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:16:34.963 15:04:15 -- common/autotest_common.sh@827 -- # '[' -z 3517623 ']' 00:16:34.963 15:04:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:34.963 15:04:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:16:34.963 15:04:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:34.963 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:34.963 15:04:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:16:34.963 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:16:35.905 15:04:16 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:16:35.905 15:04:16 -- common/autotest_common.sh@860 -- # return 0 00:16:35.905 15:04:16 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:16:35.905 15:04:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:35.905 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:16:35.905 15:04:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:35.905 15:04:16 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:35.905 15:04:16 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:16:35.905 15:04:16 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:35.905 15:04:16 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:35.905 15:04:16 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:16:35.905 15:04:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:35.905 15:04:16 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:16:35.905 15:04:16 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:16:35.905 15:04:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:35.905 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:16:35.905 Nvme_mlx_0_0n1 00:16:35.905 15:04:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:35.905 15:04:16 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:35.905 15:04:16 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:16:35.905 15:04:16 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:35.905 15:04:16 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:35.905 15:04:16 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:16:35.905 15:04:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:35.905 15:04:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:35.905 15:04:16 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:16:35.905 15:04:16 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:16:35.905 15:04:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:35.905 15:04:16 -- common/autotest_common.sh@10 -- # set +x 00:16:35.905 Nvme_mlx_0_1n1 00:16:35.905 15:04:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:35.905 15:04:16 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3517897 00:16:35.905 15:04:16 -- target/device_removal.sh@112 -- # sleep 5 00:16:35.905 15:04:16 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:16:41.196 15:04:21 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:41.196 15:04:21 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:16:41.196 15:04:21 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0/infiniband 00:16:41.196 15:04:21 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:16:41.196 15:04:21 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:16:41.196 15:04:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:41.196 15:04:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:41.196 15:04:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.196 15:04:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.196 15:04:21 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:16:41.196 15:04:21 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:16:41.196 15:04:21 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0 00:16:41.196 15:04:21 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:41.196 15:04:21 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:41.196 15:04:21 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:41.196 15:04:21 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:41.196 15:04:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:41.196 15:04:21 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:41.196 15:04:21 -- common/autotest_common.sh@10 -- # set +x 00:16:41.196 15:04:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:41.196 mlx5_0 00:16:41.196 15:04:21 -- target/device_removal.sh@78 -- # return 0 00:16:41.196 15:04:21 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@67 -- # echo 1 00:16:41.196 15:04:21 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:41.196 15:04:21 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:16:41.196 [2024-04-26 15:04:21.945906] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:16:41.196 [2024-04-26 15:04:21.945993] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:41.196 [2024-04-26 15:04:21.946080] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:41.196 [2024-04-26 15:04:21.946093] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 94 00:16:41.196 [2024-04-26 15:04:21.946100] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:16:41.196 [2024-04-26 15:04:21.946107] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946112] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946123] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946130] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946135] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946141] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946147] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946153] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946159] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946164] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946169] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946175] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946180] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946185] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946191] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.196 [2024-04-26 15:04:21.946196] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.196 [2024-04-26 15:04:21.946202] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946208] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946213] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946219] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946224] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946229] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946235] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946240] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946246] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946252] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946258] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946263] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946269] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946285] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946291] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946296] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946301] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946307] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946313] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946318] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946324] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946329] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946334] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946340] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946351] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946356] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946367] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946373] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946378] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946384] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946389] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946396] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946402] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946407] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946412] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946418] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946423] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946428] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946433] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946439] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946444] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946449] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946455] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946461] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946466] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946472] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946477] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946482] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946487] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946493] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946498] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946503] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946509] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946514] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946520] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946525] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946531] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946536] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946541] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946546] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946552] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946557] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946562] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946567] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946573] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946578] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946584] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946591] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946596] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946602] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946607] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946612] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946618] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946623] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946628] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946634] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946639] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946644] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946650] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946655] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946660] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946665] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946671] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946676] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946682] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946688] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946694] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946699] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946704] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946709] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946715] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946720] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946725] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946730] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946736] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946742] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946747] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946752] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946758] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946763] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946768] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.197 [2024-04-26 15:04:21.946773] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.197 [2024-04-26 15:04:21.946779] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946784] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946790] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946796] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946802] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946808] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946813] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946819] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946825] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946830] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946835] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946840] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946846] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.197 [2024-04-26 15:04:21.946851] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.197 [2024-04-26 15:04:21.946857] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946862] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946868] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946873] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946878] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946883] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946889] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946894] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946900] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946905] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946910] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.198 [2024-04-26 15:04:21.946916] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.198 [2024-04-26 15:04:21.946921] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946926] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946931] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946936] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946942] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946947] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946953] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946958] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946963] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946968] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946974] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.946979] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.946984] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.198 [2024-04-26 15:04:21.946989] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.198 [2024-04-26 15:04:21.946995] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947000] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947006] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947011] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947016] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947021] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947027] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.198 [2024-04-26 15:04:21.947032] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.198 [2024-04-26 15:04:21.947037] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947043] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947049] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:16:41.198 [2024-04-26 15:04:21.947055] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:41.198 [2024-04-26 15:04:21.947060] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947065] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947070] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947076] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947081] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947086] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947091] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947097] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947102] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947108] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947113] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947118] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947124] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947130] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:41.198 [2024-04-26 15:04:21.947135] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:41.198 [2024-04-26 15:04:21.947140] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:46.484 15:04:26 -- target/device_removal.sh@147 -- # seq 1 10 00:16:46.484 15:04:26 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:46.484 15:04:26 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:46.484 15:04:26 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:46.484 15:04:26 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:46.484 15:04:26 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:46.484 15:04:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:46.484 15:04:26 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:46.484 15:04:26 -- common/autotest_common.sh@10 -- # set +x 00:16:46.484 15:04:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:46.484 15:04:26 -- target/device_removal.sh@78 -- # return 1 00:16:46.484 15:04:26 -- target/device_removal.sh@149 -- # break 00:16:46.484 15:04:26 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:46.484 15:04:26 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:46.484 15:04:26 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:46.484 15:04:26 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:46.484 15:04:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:46.484 15:04:26 -- common/autotest_common.sh@10 -- # set +x 00:16:46.484 15:04:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:46.484 15:04:26 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:46.484 15:04:26 -- target/device_removal.sh@160 -- # rescan_pci 00:16:46.484 15:04:26 -- target/device_removal.sh@57 -- # echo 1 00:16:47.057 [2024-04-26 15:04:27.872634] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x19d7570, err 11. Skip rescan. 00:16:47.057 15:04:27 -- target/device_removal.sh@162 -- # seq 1 10 00:16:47.057 15:04:27 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:47.057 15:04:27 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0/net 00:16:47.057 15:04:27 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:16:47.057 15:04:27 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:16:47.057 15:04:27 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:16:47.057 15:04:27 -- target/device_removal.sh@171 -- # break 00:16:47.057 15:04:27 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:16:47.057 15:04:27 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:16:47.057 [2024-04-26 15:04:27.977554] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x179a540/0x179ea30) succeed. 00:16:47.057 [2024-04-26 15:04:27.977608] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:16:48.443 15:04:29 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:16:48.443 15:04:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:48.443 15:04:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:48.443 15:04:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:48.443 15:04:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:48.443 15:04:29 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:48.444 15:04:29 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:16:48.444 15:04:29 -- target/device_removal.sh@186 -- # seq 1 10 00:16:48.444 15:04:29 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:48.444 15:04:29 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:48.444 15:04:29 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:48.444 15:04:29 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:48.444 15:04:29 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:48.444 15:04:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:48.444 15:04:29 -- common/autotest_common.sh@10 -- # set +x 00:16:48.444 [2024-04-26 15:04:29.135328] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:48.444 [2024-04-26 15:04:29.135358] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:16:48.444 [2024-04-26 15:04:29.135370] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:48.444 [2024-04-26 15:04:29.135379] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:48.444 15:04:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:48.444 15:04:29 -- target/device_removal.sh@187 -- # ib_count=2 00:16:48.444 15:04:29 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:48.444 15:04:29 -- target/device_removal.sh@189 -- # break 00:16:48.444 15:04:29 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:48.444 15:04:29 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:16:48.444 15:04:29 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1/infiniband 00:16:48.444 15:04:29 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:16:48.444 15:04:29 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:16:48.444 15:04:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:48.444 15:04:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:48.444 15:04:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:48.444 15:04:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:48.444 15:04:29 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:16:48.444 15:04:29 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:16:48.444 15:04:29 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1 00:16:48.444 15:04:29 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:48.444 15:04:29 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:48.444 15:04:29 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:48.444 15:04:29 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:48.444 15:04:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:48.444 15:04:29 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:48.444 15:04:29 -- common/autotest_common.sh@10 -- # set +x 00:16:48.444 15:04:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:48.444 mlx5_1 00:16:48.444 15:04:29 -- target/device_removal.sh@78 -- # return 0 00:16:48.444 15:04:29 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@67 -- # echo 1 00:16:48.444 15:04:29 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:48.444 15:04:29 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:16:48.444 [2024-04-26 15:04:29.302571] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:16:48.444 [2024-04-26 15:04:29.304946] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:16:48.444 [2024-04-26 15:04:29.307288] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:48.444 [2024-04-26 15:04:29.307302] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 96 00:16:48.444 [2024-04-26 15:04:29.307309] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:16:48.444 [2024-04-26 15:04:29.307315] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307321] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307326] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307332] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307337] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307342] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307348] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307353] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307358] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307364] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307369] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307374] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307380] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307385] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:16:48.444 [2024-04-26 15:04:29.307390] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307395] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307401] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307406] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307416] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307422] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307428] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307433] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307438] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307443] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307448] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307454] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307459] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307465] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307470] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307475] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307485] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307490] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307496] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307501] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307506] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307511] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307516] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307521] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307526] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307531] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307537] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307542] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307548] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307553] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307558] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307563] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307568] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307573] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307578] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307584] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307589] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307596] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307601] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307606] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307612] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307617] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307622] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307627] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307632] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307637] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307642] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307648] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307653] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307659] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307664] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307670] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307677] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307682] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307688] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307693] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307698] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307704] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307711] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307720] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307726] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.444 [2024-04-26 15:04:29.307731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.444 [2024-04-26 15:04:29.307736] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307741] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307746] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307752] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307757] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307762] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307767] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307772] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307777] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307782] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307788] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307793] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307798] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307803] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307808] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307813] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307818] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307824] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307830] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307835] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307840] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307845] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307850] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307861] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307866] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307871] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307876] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307881] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307887] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307892] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307897] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307902] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307907] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307912] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307918] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307923] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307928] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307936] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307941] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307946] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307952] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307957] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307962] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307967] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307972] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307977] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307983] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307988] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.307993] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.307998] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308004] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308009] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308015] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308020] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308025] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308031] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308036] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308041] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308047] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308053] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308058] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308063] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308069] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308074] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308080] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308085] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308091] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308096] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308101] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308106] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308111] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308116] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308122] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308127] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308133] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308138] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308143] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308148] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308155] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308160] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308165] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308170] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308176] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308181] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308186] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308191] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308196] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308202] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308207] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308212] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308217] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308222] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308227] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308233] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308238] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308243] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308248] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308253] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308258] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308263] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308269] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308283] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308288] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308294] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308299] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308304] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308309] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308315] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308320] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308325] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308330] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:48.445 [2024-04-26 15:04:29.308335] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:16:48.445 [2024-04-26 15:04:29.308341] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:16:53.785 15:04:34 -- target/device_removal.sh@147 -- # seq 1 10 00:16:53.785 15:04:34 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:53.785 15:04:34 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:53.785 15:04:34 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:53.785 15:04:34 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:53.785 15:04:34 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:53.785 15:04:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:53.785 15:04:34 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:53.785 15:04:34 -- common/autotest_common.sh@10 -- # set +x 00:16:53.785 15:04:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:53.785 15:04:34 -- target/device_removal.sh@78 -- # return 1 00:16:53.785 15:04:34 -- target/device_removal.sh@149 -- # break 00:16:53.785 15:04:34 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:53.785 15:04:34 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:53.785 15:04:34 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:53.785 15:04:34 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:53.785 15:04:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:53.785 15:04:34 -- common/autotest_common.sh@10 -- # set +x 00:16:53.785 15:04:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:53.785 15:04:34 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:53.785 15:04:34 -- target/device_removal.sh@160 -- # rescan_pci 00:16:53.785 15:04:34 -- target/device_removal.sh@57 -- # echo 1 00:16:54.727 [2024-04-26 15:04:35.420016] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x19a4b30, err 11. Skip rescan. 00:16:54.727 15:04:35 -- target/device_removal.sh@162 -- # seq 1 10 00:16:54.727 15:04:35 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:54.727 15:04:35 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1/net 00:16:54.727 15:04:35 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:16:54.727 15:04:35 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:16:54.727 15:04:35 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:16:54.727 15:04:35 -- target/device_removal.sh@171 -- # break 00:16:54.727 15:04:35 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:16:54.727 15:04:35 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:16:54.727 [2024-04-26 15:04:35.521154] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x179a210/0x17e00c0) succeed. 00:16:54.727 [2024-04-26 15:04:35.521208] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:16:56.115 15:04:36 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:16:56.115 15:04:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:56.115 15:04:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:56.115 15:04:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.115 15:04:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.115 15:04:36 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:56.115 15:04:36 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:16:56.115 15:04:36 -- target/device_removal.sh@186 -- # seq 1 10 00:16:56.115 15:04:36 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:56.115 15:04:36 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:56.115 15:04:36 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:56.115 15:04:36 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:56.115 15:04:36 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:56.115 15:04:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:56.115 [2024-04-26 15:04:36.690127] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:56.115 [2024-04-26 15:04:36.690156] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:16:56.115 [2024-04-26 15:04:36.690168] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:56.115 [2024-04-26 15:04:36.690178] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:56.115 15:04:36 -- common/autotest_common.sh@10 -- # set +x 00:16:56.115 15:04:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:56.115 15:04:36 -- target/device_removal.sh@187 -- # ib_count=2 00:16:56.115 15:04:36 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:56.115 15:04:36 -- target/device_removal.sh@189 -- # break 00:16:56.115 15:04:36 -- target/device_removal.sh@200 -- # stop_bdevperf 00:16:56.115 15:04:36 -- target/device_removal.sh@116 -- # wait 3517897 00:18:17.609 0 00:18:17.609 15:05:47 -- target/device_removal.sh@118 -- # killprocess 3517623 00:18:17.609 15:05:47 -- common/autotest_common.sh@946 -- # '[' -z 3517623 ']' 00:18:17.609 15:05:47 -- common/autotest_common.sh@950 -- # kill -0 3517623 00:18:17.609 15:05:47 -- common/autotest_common.sh@951 -- # uname 00:18:17.609 15:05:47 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:17.609 15:05:47 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3517623 00:18:17.609 15:05:47 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:18:17.609 15:05:47 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:18:17.609 15:05:47 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3517623' 00:18:17.609 killing process with pid 3517623 00:18:17.609 15:05:47 -- common/autotest_common.sh@965 -- # kill 3517623 00:18:17.609 15:05:47 -- common/autotest_common.sh@970 -- # wait 3517623 00:18:17.609 15:05:47 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:18:17.609 15:05:47 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:18:17.609 [2024-04-26 15:04:15.826597] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:18:17.609 [2024-04-26 15:04:15.826670] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3517623 ] 00:18:17.609 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.609 [2024-04-26 15:04:15.885754] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.609 [2024-04-26 15:04:15.936568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:17.609 Running I/O for 90 seconds... 00:18:17.609 [2024-04-26 15:04:21.938195] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:18:17.609 [2024-04-26 15:04:21.938229] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.609 [2024-04-26 15:04:21.938237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:6 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.609 [2024-04-26 15:04:21.938244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.609 [2024-04-26 15:04:21.938249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:6 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.609 [2024-04-26 15:04:21.938255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.609 [2024-04-26 15:04:21.938260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:6 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.609 [2024-04-26 15:04:21.938266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.609 [2024-04-26 15:04:21.938271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:6 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.609 [2024-04-26 15:04:21.940068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.609 [2024-04-26 15:04:21.940079] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.609 [2024-04-26 15:04:21.940096] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:17.609 [2024-04-26 15:04:21.948107] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:21.958129] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:21.968154] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:21.978179] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:21.988205] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:21.998229] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.008257] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.018283] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.028307] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.038331] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.048358] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.058383] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.068708] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.078733] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.088815] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.098962] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.109632] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.119658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.129682] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.139706] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.149874] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.159895] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.170561] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.180661] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.190684] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.200711] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.211082] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.221108] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.231523] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.241549] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.252082] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.262117] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.272637] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.282880] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.292905] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.303281] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.313299] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.323326] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.333571] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.344207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.354407] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.364971] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.374996] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.385348] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.395374] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.405399] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.415425] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.425731] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.435757] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.445783] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.455965] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.466041] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.476066] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.486089] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.496365] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.609 [2024-04-26 15:04:22.506390] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.517102] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.527238] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.537264] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.547288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.557533] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.567557] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.578122] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.588234] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.598836] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.608860] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.618885] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.629138] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.639163] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.649190] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.659213] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.669241] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.679264] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.689290] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.699316] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.709340] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.719365] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.729390] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.739414] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.749440] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.759466] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.769493] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.779519] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.789543] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.799569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.809592] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.819618] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.829642] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.839666] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.849693] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.859717] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.869846] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.879873] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.890398] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.900424] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.910785] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.920811] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.931331] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.941358] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.610 [2024-04-26 15:04:22.942457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:222088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:222096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:222104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:222112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:222120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:222128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:222136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:222144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:222152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:222160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:222168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:222176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:222184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:222192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:222200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.610 [2024-04-26 15:04:22.942636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:221184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x187e00 00:18:17.610 [2024-04-26 15:04:22.942649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:221192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x187e00 00:18:17.610 [2024-04-26 15:04:22.942661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:221200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x187e00 00:18:17.610 [2024-04-26 15:04:22.942673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:221208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x187e00 00:18:17.610 [2024-04-26 15:04:22.942684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.610 [2024-04-26 15:04:22.942691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:221216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x187e00 00:18:17.610 [2024-04-26 15:04:22.942696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:221224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:221232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:221240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:221248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:221256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:221264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:221272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:221280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:221288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:221296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:221304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:221312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:221320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:221328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:221336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:221344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:221352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:221360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:221368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:221376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:221384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:221392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:221400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:221408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.942990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:221416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.942995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:221424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:221432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:221440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:221448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:221456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:221464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:221472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:221480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:221488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.611 [2024-04-26 15:04:22.943109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:221496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x187e00 00:18:17.611 [2024-04-26 15:04:22.943114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:221504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:221512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:221520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:221528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:221536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:221544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:221552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:221560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:221568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:221576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:221584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:221592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:221600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:221608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:221616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:221624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:221632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:221640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:221648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:221656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:221664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:221672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:221680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:221688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777e000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:221696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007780000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:221704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:221712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:221720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:221728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:221736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:221744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:221752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:221760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:221768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:221776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x187e00 00:18:17.612 [2024-04-26 15:04:22.943537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.612 [2024-04-26 15:04:22.943544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:221784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:221792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:221800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:221808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:221816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:221824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:221832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:221840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:221848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:221856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:221864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:221872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:221880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:221888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:221896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:221904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:221912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:221920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:221928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:221936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:221944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:221952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:221960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:221968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:221976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:221984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.943843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.943850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:221992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.952108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.613 [2024-04-26 15:04:22.952137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:222000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x187e00 00:18:17.613 [2024-04-26 15:04:22.952144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:222008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:222016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:222024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:222032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:222040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:222048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.952222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:222056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x187e00 00:18:17.614 [2024-04-26 15:04:22.952227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.964225] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:18:17.614 [2024-04-26 15:04:22.964274] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:17.614 [2024-04-26 15:04:22.964282] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:17.614 [2024-04-26 15:04:22.964287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:222064 len:8 PRP1 0x0 PRP2 0x0 00:18:17.614 [2024-04-26 15:04:22.964293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:22.965623] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.614 [2024-04-26 15:04:22.966011] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:18:17.614 [2024-04-26 15:04:22.966021] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.614 [2024-04-26 15:04:22.966026] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:17.614 [2024-04-26 15:04:22.966037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.614 [2024-04-26 15:04:22.966042] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.614 [2024-04-26 15:04:22.966051] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:18:17.614 [2024-04-26 15:04:22.966056] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:18:17.614 [2024-04-26 15:04:22.966062] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:18:17.614 [2024-04-26 15:04:22.966076] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.614 [2024-04-26 15:04:22.966081] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.614 [2024-04-26 15:04:23.968491] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:18:17.614 [2024-04-26 15:04:23.968510] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.614 [2024-04-26 15:04:23.968515] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:17.614 [2024-04-26 15:04:23.968526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.614 [2024-04-26 15:04:23.968531] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.614 [2024-04-26 15:04:23.968540] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:18:17.614 [2024-04-26 15:04:23.968545] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:18:17.614 [2024-04-26 15:04:23.968551] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:18:17.614 [2024-04-26 15:04:23.968566] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.614 [2024-04-26 15:04:23.968571] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.614 [2024-04-26 15:04:25.973313] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.614 [2024-04-26 15:04:25.973336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:17.614 [2024-04-26 15:04:25.973351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.614 [2024-04-26 15:04:25.973356] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.614 [2024-04-26 15:04:25.973369] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:18:17.614 [2024-04-26 15:04:25.973374] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:18:17.614 [2024-04-26 15:04:25.973380] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:18:17.614 [2024-04-26 15:04:25.973395] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.614 [2024-04-26 15:04:25.973401] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.614 [2024-04-26 15:04:27.978577] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.614 [2024-04-26 15:04:27.978596] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:17.614 [2024-04-26 15:04:27.978612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.614 [2024-04-26 15:04:27.978618] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.614 [2024-04-26 15:04:27.978628] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:18:17.614 [2024-04-26 15:04:27.978633] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:18:17.614 [2024-04-26 15:04:27.978639] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:18:17.614 [2024-04-26 15:04:27.978654] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.614 [2024-04-26 15:04:27.978660] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.614 [2024-04-26 15:04:29.309273] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:17.614 [2024-04-26 15:04:29.309299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.614 [2024-04-26 15:04:29.309306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:16 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:29.309313] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.614 [2024-04-26 15:04:29.309318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:16 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:29.309324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.614 [2024-04-26 15:04:29.309330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:16 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:29.309336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:17.614 [2024-04-26 15:04:29.309341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32699 cdw0:16 sqhd:23b9 p:0 m:0 dnr:0 00:18:17.614 [2024-04-26 15:04:29.318146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.614 [2024-04-26 15:04:29.318167] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.614 [2024-04-26 15:04:29.318194] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:17.614 [2024-04-26 15:04:29.319284] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.329310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.339334] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.349358] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.359383] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.369411] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.379436] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.389464] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.399489] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.409515] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.419540] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.429565] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.439592] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.449619] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.614 [2024-04-26 15:04:29.459642] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.469667] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.479692] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.489718] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.499746] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.509773] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.519798] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.529825] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.539853] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.549877] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.559903] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.569927] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.579952] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.589979] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.600006] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.610033] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.620057] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.630083] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.640107] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.650134] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.660158] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.670186] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.680210] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.690238] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.700262] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.710287] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.720315] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.730339] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.740366] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.750390] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.760416] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.770443] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.780468] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.790492] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.800520] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.810548] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.820575] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.830599] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.840624] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.850650] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.860674] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.870702] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.880726] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.890752] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.900775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.910803] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.920828] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.930852] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.940877] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.950902] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.960930] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.970957] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.980981] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:29.983564] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.615 [2024-04-26 15:04:29.983570] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:17.615 [2024-04-26 15:04:29.983583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.615 [2024-04-26 15:04:29.983588] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:18:17.615 [2024-04-26 15:04:29.983597] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:18:17.615 [2024-04-26 15:04:29.983601] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:18:17.615 [2024-04-26 15:04:29.983607] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:18:17.615 [2024-04-26 15:04:29.983621] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.615 [2024-04-26 15:04:29.983627] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:18:17.615 [2024-04-26 15:04:29.991004] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.001028] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.011054] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.021078] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.031103] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.041130] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.051156] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.061182] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.071208] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.081232] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.091256] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.101281] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.111306] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.121331] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.131355] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.141381] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.151407] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.161432] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.171457] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.181481] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.191505] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.201532] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.211557] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.221583] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.231609] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.241633] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.251657] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.615 [2024-04-26 15:04:30.261681] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.271704] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.281731] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.291755] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.301781] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.311805] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:17.616 [2024-04-26 15:04:30.320557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:256784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:256792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:256800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:256808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:256816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:256824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:256832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:256840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:256848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:256856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:256864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:256872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:256880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:256888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:256896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:256904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:256912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:256920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e6000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:256928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e8000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:256936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ea000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:256944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ec000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:256952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ee000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:256960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f0000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:256968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f2000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:256976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f4000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:256984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f6000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:256992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f8000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:257000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:257008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:257016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x1c1300 00:18:17.616 [2024-04-26 15:04:30.320914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:257024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.616 [2024-04-26 15:04:30.320926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:257032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.616 [2024-04-26 15:04:30.320937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:257040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.616 [2024-04-26 15:04:30.320950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.616 [2024-04-26 15:04:30.320956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:257048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.320961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.320968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:257056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.320972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.320979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:257064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.320984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.320990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:257072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.320995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:257080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:257088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:257096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:257104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:257112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:257120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:257128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:257136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:257144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:257152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:257160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:257168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:257176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:257184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:257192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:257200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:257208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:257216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:257224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:257232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:257240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:257248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:257256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:257264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:257272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:257280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:257288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:257296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:257304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:257312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:257320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.617 [2024-04-26 15:04:30.321343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.617 [2024-04-26 15:04:30.321349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:257328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:257336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:257344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:257352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:257360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:257368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:257376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:257384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:257392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:257400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:257408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:257416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:257424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:257432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:257440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:257448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:257456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:257464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:257472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:257480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:257488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:257496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:257504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:257512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:257520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:257528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:257536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.618 [2024-04-26 15:04:30.321642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.618 [2024-04-26 15:04:30.321648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:257544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:257552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:257560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:257568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:257576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:257584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:257592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:257600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:257608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:257616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:257624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:257632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:257640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:257648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:257656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:257664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:257672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:257680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:257688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:257696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:257704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:257712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:257720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:257728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:257736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:257744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:257752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:257760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:257768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:257776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:257784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.321994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:257792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:17.619 [2024-04-26 15:04:30.321999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32699 cdw0:fa64cc00 sqhd:f530 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.334037] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:17.619 [2024-04-26 15:04:30.334046] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:17.619 [2024-04-26 15:04:30.334051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:257800 len:8 PRP1 0x0 PRP2 0x0 00:18:17.619 [2024-04-26 15:04:30.334057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:17.619 [2024-04-26 15:04:30.334091] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.619 [2024-04-26 15:04:30.334305] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:18:17.619 [2024-04-26 15:04:30.334314] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.619 [2024-04-26 15:04:30.334318] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:18:17.619 [2024-04-26 15:04:30.334328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.619 [2024-04-26 15:04:30.334333] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.619 [2024-04-26 15:04:30.334340] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:18:17.619 [2024-04-26 15:04:30.334345] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:18:17.619 [2024-04-26 15:04:30.334350] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:18:17.619 [2024-04-26 15:04:30.334363] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.619 [2024-04-26 15:04:30.334368] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.619 [2024-04-26 15:04:31.040814] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:17.619 [2024-04-26 15:04:31.336836] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:18:17.620 [2024-04-26 15:04:31.336847] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.620 [2024-04-26 15:04:31.336852] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:18:17.620 [2024-04-26 15:04:31.336862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.620 [2024-04-26 15:04:31.336867] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.620 [2024-04-26 15:04:31.336875] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:18:17.620 [2024-04-26 15:04:31.336885] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:18:17.620 [2024-04-26 15:04:31.336890] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:18:17.620 [2024-04-26 15:04:31.336902] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.620 [2024-04-26 15:04:31.336906] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.620 [2024-04-26 15:04:32.340093] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:18:17.620 [2024-04-26 15:04:32.340112] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.620 [2024-04-26 15:04:32.340117] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:18:17.620 [2024-04-26 15:04:32.340129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.620 [2024-04-26 15:04:32.340135] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.620 [2024-04-26 15:04:32.340880] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:18:17.620 [2024-04-26 15:04:32.340887] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:18:17.620 [2024-04-26 15:04:32.340892] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:18:17.620 [2024-04-26 15:04:32.340907] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.620 [2024-04-26 15:04:32.340912] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.620 [2024-04-26 15:04:34.345661] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.620 [2024-04-26 15:04:34.345686] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:18:17.620 [2024-04-26 15:04:34.345704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.620 [2024-04-26 15:04:34.345710] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.620 [2024-04-26 15:04:34.345739] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:18:17.620 [2024-04-26 15:04:34.345745] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:18:17.620 [2024-04-26 15:04:34.345750] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:18:17.620 [2024-04-26 15:04:34.345768] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.620 [2024-04-26 15:04:34.345773] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.620 [2024-04-26 15:04:36.351150] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:18:17.620 [2024-04-26 15:04:36.351178] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:18:17.620 [2024-04-26 15:04:36.351196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:17.620 [2024-04-26 15:04:36.351202] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:18:17.620 [2024-04-26 15:04:36.351212] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:18:17.620 [2024-04-26 15:04:36.351217] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:18:17.620 [2024-04-26 15:04:36.351223] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:18:17.620 [2024-04-26 15:04:36.351271] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:17.620 [2024-04-26 15:04:36.351281] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:18:17.620 [2024-04-26 15:04:37.407841] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:17.620 00:18:17.620 Latency(us) 00:18:17.620 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.620 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:17.620 Verification LBA range: start 0x0 length 0x8000 00:18:17.620 Nvme_mlx_0_0n1 : 90.01 10978.11 42.88 0.00 0.00 11642.49 2252.80 10066329.60 00:18:17.620 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:17.620 Verification LBA range: start 0x0 length 0x8000 00:18:17.620 Nvme_mlx_0_1n1 : 90.01 10256.15 40.06 0.00 0.00 12461.31 2717.01 9059696.64 00:18:17.620 =================================================================================================================== 00:18:17.620 Total : 21234.26 82.95 0.00 0.00 12037.98 2252.80 10066329.60 00:18:17.620 Received shutdown signal, test time was about 90.000000 seconds 00:18:17.620 00:18:17.620 Latency(us) 00:18:17.620 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.620 =================================================================================================================== 00:18:17.620 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:17.620 15:05:47 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:18:17.620 15:05:47 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:18:17.620 15:05:47 -- target/device_removal.sh@202 -- # killprocess 3517306 00:18:17.620 15:05:47 -- common/autotest_common.sh@946 -- # '[' -z 3517306 ']' 00:18:17.620 15:05:47 -- common/autotest_common.sh@950 -- # kill -0 3517306 00:18:17.620 15:05:47 -- common/autotest_common.sh@951 -- # uname 00:18:17.620 15:05:47 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:17.620 15:05:47 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3517306 00:18:17.620 15:05:47 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:18:17.620 15:05:47 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:18:17.620 15:05:47 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3517306' 00:18:17.620 killing process with pid 3517306 00:18:17.620 15:05:47 -- common/autotest_common.sh@965 -- # kill 3517306 00:18:17.620 15:05:47 -- common/autotest_common.sh@970 -- # wait 3517306 00:18:17.620 [2024-04-26 15:05:47.437688] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:17.620 15:05:47 -- target/device_removal.sh@203 -- # nvmfpid= 00:18:17.620 15:05:47 -- target/device_removal.sh@205 -- # return 0 00:18:17.620 00:18:17.620 real 1m32.974s 00:18:17.620 user 4m27.575s 00:18:17.620 sys 0m4.279s 00:18:17.620 15:05:47 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:17.620 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:18:17.620 ************************************ 00:18:17.620 END TEST nvmf_device_removal_pci_remove_no_srq 00:18:17.620 ************************************ 00:18:17.620 15:05:47 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:18:17.620 15:05:47 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:18:17.620 15:05:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:17.620 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:18:17.620 ************************************ 00:18:17.620 START TEST nvmf_device_removal_pci_remove 00:18:17.620 ************************************ 00:18:17.620 15:05:47 -- common/autotest_common.sh@1121 -- # test_remove_and_rescan 00:18:17.620 15:05:47 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:18:17.620 15:05:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:17.620 15:05:47 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:17.620 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:18:17.620 15:05:47 -- nvmf/common.sh@470 -- # nvmfpid=3535674 00:18:17.620 15:05:47 -- nvmf/common.sh@471 -- # waitforlisten 3535674 00:18:17.620 15:05:47 -- common/autotest_common.sh@827 -- # '[' -z 3535674 ']' 00:18:17.620 15:05:47 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.620 15:05:47 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:17.620 15:05:47 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.620 15:05:47 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:17.620 15:05:47 -- common/autotest_common.sh@10 -- # set +x 00:18:17.620 15:05:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:18:17.620 [2024-04-26 15:05:47.825104] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:18:17.620 [2024-04-26 15:05:47.825153] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.620 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.620 [2024-04-26 15:05:47.885717] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:18:17.621 [2024-04-26 15:05:47.949439] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.621 [2024-04-26 15:05:47.949473] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.621 [2024-04-26 15:05:47.949481] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:17.621 [2024-04-26 15:05:47.949488] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:17.621 [2024-04-26 15:05:47.949493] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.621 [2024-04-26 15:05:47.949597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.621 [2024-04-26 15:05:47.949601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:17.621 15:05:48 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:17.621 15:05:48 -- common/autotest_common.sh@860 -- # return 0 00:18:17.621 15:05:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:17.621 15:05:48 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.621 15:05:48 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:18:17.621 15:05:48 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:18:17.621 15:05:48 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:18:17.621 15:05:48 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 [2024-04-26 15:05:48.664371] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x133d540/0x1341a30) succeed. 00:18:17.621 [2024-04-26 15:05:48.676437] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x133ea40/0x13830c0) succeed. 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:18:17.621 15:05:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:17.621 15:05:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:17.621 15:05:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:17.621 15:05:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:17.621 15:05:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:17.621 15:05:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:17.621 15:05:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:17.621 15:05:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:17.621 15:05:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:17.621 15:05:48 -- nvmf/common.sh@105 -- # continue 2 00:18:17.621 15:05:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:17.621 15:05:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:17.621 15:05:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:17.621 15:05:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:17.621 15:05:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:17.621 15:05:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:17.621 15:05:48 -- nvmf/common.sh@105 -- # continue 2 00:18:17.621 15:05:48 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:18:17.621 15:05:48 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@25 -- # local -a dev_name 00:18:17.621 15:05:48 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:18:17.621 15:05:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:17.621 15:05:48 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:18:17.621 15:05:48 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:18:17.621 15:05:48 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:18:17.621 15:05:48 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 [2024-04-26 15:05:48.863319] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@41 -- # return 0 00:18:17.621 15:05:48 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:18:17.621 15:05:48 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:18:17.621 15:05:48 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@25 -- # local -a dev_name 00:18:17.621 15:05:48 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:18:17.621 15:05:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:17.621 15:05:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:17.621 15:05:48 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:18:17.621 15:05:48 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:18:17.621 15:05:48 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:18:17.621 15:05:48 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:18:17.621 15:05:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 [2024-04-26 15:05:48.939738] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:18:17.621 15:05:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.621 15:05:48 -- target/device_removal.sh@41 -- # return 0 00:18:17.621 15:05:48 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@53 -- # return 0 00:18:17.621 15:05:48 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:18:17.621 15:05:48 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:18:17.621 15:05:48 -- target/device_removal.sh@87 -- # local dev_names 00:18:17.621 15:05:48 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:17.621 15:05:48 -- target/device_removal.sh@91 -- # bdevperf_pid=3536011 00:18:17.621 15:05:48 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:17.621 15:05:48 -- target/device_removal.sh@94 -- # waitforlisten 3536011 /var/tmp/bdevperf.sock 00:18:17.621 15:05:48 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:18:17.621 15:05:48 -- common/autotest_common.sh@827 -- # '[' -z 3536011 ']' 00:18:17.621 15:05:48 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:17.621 15:05:48 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:17.621 15:05:48 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:17.621 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:17.621 15:05:48 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:17.621 15:05:48 -- common/autotest_common.sh@10 -- # set +x 00:18:17.621 15:05:49 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:17.621 15:05:49 -- common/autotest_common.sh@860 -- # return 0 00:18:17.622 15:05:49 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:18:17.622 15:05:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.622 15:05:49 -- common/autotest_common.sh@10 -- # set +x 00:18:17.622 15:05:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.622 15:05:49 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:18:17.622 15:05:49 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:18:17.622 15:05:49 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:18:17.622 15:05:49 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:18:17.622 15:05:49 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:18:17.622 15:05:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:17.622 15:05:49 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:18:17.622 15:05:49 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:18:17.622 15:05:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.622 15:05:49 -- common/autotest_common.sh@10 -- # set +x 00:18:17.622 Nvme_mlx_0_0n1 00:18:17.622 15:05:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.622 15:05:49 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:18:17.622 15:05:49 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:18:17.622 15:05:49 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:18:17.622 15:05:49 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:18:17.622 15:05:49 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:18:17.622 15:05:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:17.622 15:05:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:17.622 15:05:49 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:18:17.622 15:05:49 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:18:17.622 15:05:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.622 15:05:49 -- common/autotest_common.sh@10 -- # set +x 00:18:17.622 Nvme_mlx_0_1n1 00:18:17.622 15:05:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.622 15:05:50 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3536308 00:18:17.622 15:05:50 -- target/device_removal.sh@112 -- # sleep 5 00:18:17.622 15:05:50 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:18:17.622 15:05:55 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:18:17.622 15:05:55 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:18:17.622 15:05:55 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0/infiniband 00:18:17.622 15:05:55 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:18:17.622 15:05:55 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:18:17.622 15:05:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:17.622 15:05:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:17.622 15:05:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:17.622 15:05:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:17.622 15:05:55 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:18:17.622 15:05:55 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:18:17.622 15:05:55 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0 00:18:17.622 15:05:55 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:18:17.622 15:05:55 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:18:17.622 15:05:55 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:17.622 15:05:55 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:17.622 15:05:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:17.622 15:05:55 -- common/autotest_common.sh@10 -- # set +x 00:18:17.622 15:05:55 -- target/device_removal.sh@77 -- # grep mlx5_0 00:18:17.622 15:05:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:17.622 mlx5_0 00:18:17.622 15:05:55 -- target/device_removal.sh@78 -- # return 0 00:18:17.622 15:05:55 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@67 -- # echo 1 00:18:17.622 15:05:55 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:18:17.622 15:05:55 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.0/net/mlx_0_0/device 00:18:17.622 [2024-04-26 15:05:55.137589] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:18:17.622 [2024-04-26 15:05:55.137680] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:17.622 [2024-04-26 15:05:55.139083] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:17.622 [2024-04-26 15:05:55.139112] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 64 00:18:19.539 15:06:00 -- target/device_removal.sh@147 -- # seq 1 10 00:18:19.539 15:06:00 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:18:19.539 15:06:00 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:18:19.539 15:06:00 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:18:19.539 15:06:00 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:19.539 15:06:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:19.539 15:06:00 -- common/autotest_common.sh@10 -- # set +x 00:18:19.539 15:06:00 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:19.539 15:06:00 -- target/device_removal.sh@77 -- # grep mlx5_0 00:18:19.539 15:06:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:19.539 15:06:00 -- target/device_removal.sh@78 -- # return 1 00:18:19.539 15:06:00 -- target/device_removal.sh@149 -- # break 00:18:19.539 15:06:00 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:19.539 15:06:00 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:19.539 15:06:00 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:19.539 15:06:00 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:19.539 15:06:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:19.539 15:06:00 -- common/autotest_common.sh@10 -- # set +x 00:18:19.539 15:06:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:19.539 15:06:00 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:18:19.539 15:06:00 -- target/device_removal.sh@160 -- # rescan_pci 00:18:19.539 15:06:00 -- target/device_removal.sh@57 -- # echo 1 00:18:20.483 15:06:01 -- target/device_removal.sh@162 -- # seq 1 10 00:18:20.483 15:06:01 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:18:20.483 15:06:01 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.0/net 00:18:20.483 15:06:01 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:18:20.483 15:06:01 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:18:20.483 15:06:01 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:18:20.483 15:06:01 -- target/device_removal.sh@171 -- # break 00:18:20.483 15:06:01 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:18:20.483 15:06:01 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:18:20.484 [2024-04-26 15:06:01.175497] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x15fcee0/0x1341a30) succeed. 00:18:20.484 [2024-04-26 15:06:01.175555] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:18:21.874 15:06:02 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:18:21.874 15:06:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:21.874 15:06:02 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:18:21.874 15:06:02 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:18:21.874 15:06:02 -- target/device_removal.sh@186 -- # seq 1 10 00:18:21.874 15:06:02 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:18:21.874 15:06:02 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:21.874 15:06:02 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:21.874 15:06:02 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:21.874 15:06:02 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:21.874 [2024-04-26 15:06:02.446742] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:21.874 [2024-04-26 15:06:02.446765] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:18:21.874 [2024-04-26 15:06:02.446777] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:21.874 [2024-04-26 15:06:02.446787] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:21.874 15:06:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:21.874 15:06:02 -- common/autotest_common.sh@10 -- # set +x 00:18:21.874 15:06:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:21.874 15:06:02 -- target/device_removal.sh@187 -- # ib_count=2 00:18:21.874 15:06:02 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:18:21.874 15:06:02 -- target/device_removal.sh@189 -- # break 00:18:21.874 15:06:02 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:18:21.874 15:06:02 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:18:21.874 15:06:02 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1/infiniband 00:18:21.874 15:06:02 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:18:21.874 15:06:02 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:18:21.874 15:06:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:21.874 15:06:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:21.874 15:06:02 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:18:21.874 15:06:02 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:18:21.874 15:06:02 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1 00:18:21.874 15:06:02 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:18:21.874 15:06:02 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:18:21.874 15:06:02 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:21.874 15:06:02 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:21.874 15:06:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:21.874 15:06:02 -- target/device_removal.sh@77 -- # grep mlx5_1 00:18:21.874 15:06:02 -- common/autotest_common.sh@10 -- # set +x 00:18:21.874 15:06:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:21.874 mlx5_1 00:18:21.874 15:06:02 -- target/device_removal.sh@78 -- # return 0 00:18:21.874 15:06:02 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@67 -- # echo 1 00:18:21.874 15:06:02 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:18:21.874 15:06:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:31:00.1/net/mlx_0_1/device 00:18:21.874 [2024-04-26 15:06:02.604428] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:18:21.874 [2024-04-26 15:06:02.604503] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:21.874 [2024-04-26 15:06:02.614885] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:18:21.874 [2024-04-26 15:06:02.614955] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 96 00:18:27.168 15:06:07 -- target/device_removal.sh@147 -- # seq 1 10 00:18:27.168 15:06:07 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:18:27.168 15:06:07 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:18:27.168 15:06:07 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:18:27.168 15:06:07 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:18:27.168 15:06:07 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:18:27.168 15:06:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:27.168 15:06:07 -- target/device_removal.sh@77 -- # grep mlx5_1 00:18:27.168 15:06:07 -- common/autotest_common.sh@10 -- # set +x 00:18:27.168 15:06:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:27.168 15:06:07 -- target/device_removal.sh@78 -- # return 1 00:18:27.168 15:06:07 -- target/device_removal.sh@149 -- # break 00:18:27.168 15:06:07 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:27.169 15:06:07 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:27.169 15:06:07 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:27.169 15:06:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:27.169 15:06:07 -- common/autotest_common.sh@10 -- # set +x 00:18:27.169 15:06:07 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:27.169 15:06:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:27.169 15:06:07 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:18:27.169 15:06:07 -- target/device_removal.sh@160 -- # rescan_pci 00:18:27.169 15:06:07 -- target/device_removal.sh@57 -- # echo 1 00:18:28.110 [2024-04-26 15:06:08.841768] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1329530, err 11. Skip rescan. 00:18:28.110 15:06:08 -- target/device_removal.sh@162 -- # seq 1 10 00:18:28.110 15:06:08 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:18:28.110 15:06:08 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:30/0000:30:02.0/0000:31:00.1/net 00:18:28.110 15:06:08 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:18:28.110 15:06:08 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:18:28.110 15:06:08 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:18:28.110 15:06:08 -- target/device_removal.sh@171 -- # break 00:18:28.110 15:06:08 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:18:28.110 15:06:08 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:18:28.110 [2024-04-26 15:06:08.951759] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1340850/0x13830c0) succeed. 00:18:28.110 [2024-04-26 15:06:08.951817] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:18:29.496 15:06:10 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:18:29.496 15:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:29.496 15:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:29.496 15:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:29.496 15:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:29.496 15:06:10 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:18:29.496 15:06:10 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:18:29.496 15:06:10 -- target/device_removal.sh@186 -- # seq 1 10 00:18:29.496 [2024-04-26 15:06:10.115825] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:18:29.496 [2024-04-26 15:06:10.115852] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:18:29.496 [2024-04-26 15:06:10.115864] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:29.496 [2024-04-26 15:06:10.115875] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:18:29.496 15:06:10 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:18:29.496 15:06:10 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:18:29.496 15:06:10 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:18:29.496 15:06:10 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:18:29.496 15:06:10 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:18:29.496 15:06:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:29.496 15:06:10 -- common/autotest_common.sh@10 -- # set +x 00:18:29.496 15:06:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:29.496 15:06:10 -- target/device_removal.sh@187 -- # ib_count=2 00:18:29.496 15:06:10 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:18:29.496 15:06:10 -- target/device_removal.sh@189 -- # break 00:18:29.496 15:06:10 -- target/device_removal.sh@200 -- # stop_bdevperf 00:18:29.496 15:06:10 -- target/device_removal.sh@116 -- # wait 3536308 00:19:51.069 0 00:19:51.069 15:07:20 -- target/device_removal.sh@118 -- # killprocess 3536011 00:19:51.069 15:07:20 -- common/autotest_common.sh@946 -- # '[' -z 3536011 ']' 00:19:51.069 15:07:20 -- common/autotest_common.sh@950 -- # kill -0 3536011 00:19:51.069 15:07:20 -- common/autotest_common.sh@951 -- # uname 00:19:51.069 15:07:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:51.069 15:07:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3536011 00:19:51.069 15:07:20 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:19:51.069 15:07:20 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:19:51.069 15:07:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3536011' 00:19:51.069 killing process with pid 3536011 00:19:51.069 15:07:20 -- common/autotest_common.sh@965 -- # kill 3536011 00:19:51.069 15:07:20 -- common/autotest_common.sh@970 -- # wait 3536011 00:19:51.069 15:07:20 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:19:51.069 15:07:20 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:19:51.069 [2024-04-26 15:05:48.993856] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:19:51.069 [2024-04-26 15:05:48.993912] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3536011 ] 00:19:51.069 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.069 [2024-04-26 15:05:49.043941] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:51.069 [2024-04-26 15:05:49.094814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:51.069 Running I/O for 90 seconds... 00:19:51.069 [2024-04-26 15:05:55.138590] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:51.069 [2024-04-26 15:05:55.138621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.069 [2024-04-26 15:05:55.138629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.069 [2024-04-26 15:05:55.138636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.069 [2024-04-26 15:05:55.138642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.069 [2024-04-26 15:05:55.138647] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.069 [2024-04-26 15:05:55.138653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.069 [2024-04-26 15:05:55.138658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.069 [2024-04-26 15:05:55.138663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.069 [2024-04-26 15:05:55.140191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.069 [2024-04-26 15:05:55.140202] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.069 [2024-04-26 15:05:55.140219] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:51.069 [2024-04-26 15:05:55.148597] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.158619] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.168645] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.178671] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.188696] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.198722] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.208749] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.218774] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.228799] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.238823] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.248850] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.258874] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.268900] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.278923] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.288947] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.298975] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.309000] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.319025] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.329050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.339073] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.349100] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.359123] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.369150] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.379176] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.389202] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.399228] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.409552] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.419578] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.429916] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.439941] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.450213] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.460454] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.470481] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.480790] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.490813] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.500838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.511233] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.521258] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.531661] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.541686] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.552285] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.562961] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.572985] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.583008] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.593036] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.603218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.613402] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.623899] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.633925] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.644567] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.654605] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.664632] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.674658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.684685] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.694800] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.704826] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.069 [2024-04-26 15:05:55.714862] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.725175] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.735210] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.745735] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.756262] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.766288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.776314] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.786338] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.796614] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.806888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.816910] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.827441] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.837492] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.847593] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.858288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.868313] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.878676] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.888878] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.899017] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.909041] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.919068] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.929092] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.939127] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.949152] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.959499] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.969545] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.979653] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.989708] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:55.999734] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.009847] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.019874] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.029899] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.039973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.050137] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.060164] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.070777] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.080801] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.090829] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.100853] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.110880] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.120904] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.130928] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.140955] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.070 [2024-04-26 15:05:56.142581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:234536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:234544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:234552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:234560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:234568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:234576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:234584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:234592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:234600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:234608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:234616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:234624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:234632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:234640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:234648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:234656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:234664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:234672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.070 [2024-04-26 15:05:56.142804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:234680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x186fef 00:19:51.070 [2024-04-26 15:05:56.142809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:234688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:234696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:234704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:234712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:234720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:234728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:234736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:234744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:234752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:234760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:234768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:234776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:234784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:234792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:234800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.142988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:234808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.142995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:234816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:234824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:234832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:234840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:234848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:234856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:234864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:234872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:234880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:234888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:234896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:234904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:234912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:234920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:234928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:234936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:234944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:234952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:234960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.071 [2024-04-26 15:05:56.143219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:234968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x186fef 00:19:51.071 [2024-04-26 15:05:56.143224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:234976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:234984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:234992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:235000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007780000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:235008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777e000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:235016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:235024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:235032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:235040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:235048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:235056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:235064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:235072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:235080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:235088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:235096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:235104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:235112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:235120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:235128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:235136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:235144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:235152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:235160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:235168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:235176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:235184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:235192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:235200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:235208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:235216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:235224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:235232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:235240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:235248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:235256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x186fef 00:19:51.072 [2024-04-26 15:05:56.143647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.072 [2024-04-26 15:05:56.143654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:235264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:235272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:235280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:235288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:235296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:235304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:235312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:235320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:235328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:235336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:235344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:235352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:235360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:235368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:235376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:235384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:235392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:235400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:235408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:235416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:235424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:235432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:235440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:235448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.143928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.143935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:235456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.151789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.151817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:235464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.151825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.151833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:235472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.151838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.151844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:235480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.151849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.073 [2024-04-26 15:05:56.151856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:235488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x186fef 00:19:51.073 [2024-04-26 15:05:56.151861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:235496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x186fef 00:19:51.074 [2024-04-26 15:05:56.151872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:235504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x186fef 00:19:51.074 [2024-04-26 15:05:56.151884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:235512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x186fef 00:19:51.074 [2024-04-26 15:05:56.151895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:235520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.074 [2024-04-26 15:05:56.151906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:235528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.074 [2024-04-26 15:05:56.151921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:235536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.074 [2024-04-26 15:05:56.151932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.151938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:235544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.074 [2024-04-26 15:05:56.151943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.164043] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:51.074 [2024-04-26 15:05:56.164051] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:51.074 [2024-04-26 15:05:56.164056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:235552 len:8 PRP1 0x0 PRP2 0x0 00:19:51.074 [2024-04-26 15:05:56.164061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:05:56.166323] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.074 [2024-04-26 15:05:56.166654] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:51.074 [2024-04-26 15:05:56.166664] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.074 [2024-04-26 15:05:56.166668] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:51.074 [2024-04-26 15:05:56.166679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.074 [2024-04-26 15:05:56.166684] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.074 [2024-04-26 15:05:56.166693] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:51.074 [2024-04-26 15:05:56.166697] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:51.074 [2024-04-26 15:05:56.166703] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:51.074 [2024-04-26 15:05:56.166719] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.074 [2024-04-26 15:05:56.166723] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.074 [2024-04-26 15:05:57.169565] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:51.074 [2024-04-26 15:05:57.169585] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.074 [2024-04-26 15:05:57.169589] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:51.074 [2024-04-26 15:05:57.169600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.074 [2024-04-26 15:05:57.169606] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.074 [2024-04-26 15:05:57.169614] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:51.074 [2024-04-26 15:05:57.169619] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:51.074 [2024-04-26 15:05:57.169624] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:51.074 [2024-04-26 15:05:57.169642] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.074 [2024-04-26 15:05:57.169647] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.074 [2024-04-26 15:05:59.174817] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.074 [2024-04-26 15:05:59.174842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:51.074 [2024-04-26 15:05:59.174857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.074 [2024-04-26 15:05:59.174862] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.074 [2024-04-26 15:05:59.175022] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:51.074 [2024-04-26 15:05:59.175029] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:51.074 [2024-04-26 15:05:59.175035] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:51.074 [2024-04-26 15:05:59.175058] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.074 [2024-04-26 15:05:59.175064] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.074 [2024-04-26 15:06:01.179999] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.074 [2024-04-26 15:06:01.180021] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:51.074 [2024-04-26 15:06:01.180038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.074 [2024-04-26 15:06:01.180043] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.074 [2024-04-26 15:06:01.180052] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:51.074 [2024-04-26 15:06:01.180057] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:51.074 [2024-04-26 15:06:01.180063] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:51.074 [2024-04-26 15:06:01.180079] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.074 [2024-04-26 15:06:01.180084] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.074 [2024-04-26 15:06:02.608849] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:51.074 [2024-04-26 15:06:02.608873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.074 [2024-04-26 15:06:02.608880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:06:02.608886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.074 [2024-04-26 15:06:02.608891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:06:02.608897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.074 [2024-04-26 15:06:02.608902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:06:02.608908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.074 [2024-04-26 15:06:02.608916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32631 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:19:51.074 [2024-04-26 15:06:02.620363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.074 [2024-04-26 15:06:02.620388] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.074 [2024-04-26 15:06:02.620420] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:19:51.074 [2024-04-26 15:06:02.620462] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.630464] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.640490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.650517] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.660543] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.670570] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.680597] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.690623] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.700648] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.710676] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.720700] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.730726] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.740750] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.750775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.760801] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.770828] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.780854] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.790880] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.074 [2024-04-26 15:06:02.800907] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.810932] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.820957] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.830982] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.841010] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.851035] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.861059] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.871086] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.881111] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.891135] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.901160] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.911187] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.921212] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.931240] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.941265] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.951289] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.961315] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.971341] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.981366] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:02.991391] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.001416] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.011443] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.021467] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.031494] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.041519] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.051546] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.061571] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.071598] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.081624] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.091649] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.101676] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.111701] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.121726] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.131751] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.141777] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.151802] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.161829] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.171855] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.181879] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.184990] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.075 [2024-04-26 15:06:03.184997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:19:51.075 [2024-04-26 15:06:03.185011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.075 [2024-04-26 15:06:03.185016] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:19:51.075 [2024-04-26 15:06:03.185025] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:19:51.075 [2024-04-26 15:06:03.185030] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:19:51.075 [2024-04-26 15:06:03.185036] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:19:51.075 [2024-04-26 15:06:03.185049] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.075 [2024-04-26 15:06:03.185055] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:19:51.075 [2024-04-26 15:06:03.191901] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.201925] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.211950] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.221976] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.232001] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.242028] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.252053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.262078] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.272104] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.282130] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.292157] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.302181] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.312207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.322230] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.332255] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.342283] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.352307] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.362331] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.372356] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.382380] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.392405] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.402429] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.412454] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.422478] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.432504] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.442529] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.452554] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.462578] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.472604] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.482629] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.492654] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.502678] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.512702] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.522727] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.532752] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.542775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.552801] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.562827] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.572852] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.582878] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.592902] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.602926] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.612951] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:51.075 [2024-04-26 15:06:03.622780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:53280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:53288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:53296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:53304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:53312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:53320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:53328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:53336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:53344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:53352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:53360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:53368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:53376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:53384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:53392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:53400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:53408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:53416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.622992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.622998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:53424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:53432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:53440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:53448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:53456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:53464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:53472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:53480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:53488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:53496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:53504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:53512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:53520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:53528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:53536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:53544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:53552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1c2fef 00:19:51.076 [2024-04-26 15:06:03.623187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.076 [2024-04-26 15:06:03.623193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:53560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:53568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:53576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:53584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:53592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:53600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:53608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:53616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:53624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:53632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:53640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:53648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:53656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:53664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:53672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:53680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:53688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:53696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:53704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:53712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:53720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:53728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:53736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:53744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:53752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:53760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:53768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:53776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:53784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:53792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:53800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:53808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:53816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:53824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:53832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:53840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0x1c2fef 00:19:51.077 [2024-04-26 15:06:03.623607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.077 [2024-04-26 15:06:03.623614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:53848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:53856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:53864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:53872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:53880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:53888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:53896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:53904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:53912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:53920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:53928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:53936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:53944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:53952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:53960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:53968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:53976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:53984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:53992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:54000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079bc000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:54008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079be000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:54016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c0000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:54024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c2000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:54032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:54040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:54048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:54056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:54064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:54072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:54080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:54088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:54096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0x1c2fef 00:19:51.078 [2024-04-26 15:06:03.623980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.078 [2024-04-26 15:06:03.623986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:54104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.623992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.623998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:54112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:54120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:54128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:54136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:54144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:54152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:54160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:54168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e6000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:54176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e8000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:54184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ea000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:54192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ec000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.624125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:54200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ee000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.624130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.631919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:54208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f0000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.631940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.631949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:54216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f2000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.631955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.631963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:54224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f4000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.631970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.631978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:54232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f6000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.631983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.631991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:54240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f8000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.631997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:54248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.632011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:54256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.632025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:54264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x1c2fef 00:19:51.079 [2024-04-26 15:06:03.632036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:54272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.079 [2024-04-26 15:06:03.632048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:54280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.079 [2024-04-26 15:06:03.632060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.632066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:54288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:51.079 [2024-04-26 15:06:03.632074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32631 cdw0:5c7caa0 sqhd:6530 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.644121] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:51.079 [2024-04-26 15:06:03.644129] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:51.079 [2024-04-26 15:06:03.644134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:54296 len:8 PRP1 0x0 PRP2 0x0 00:19:51.079 [2024-04-26 15:06:03.644139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:51.079 [2024-04-26 15:06:03.644174] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.079 [2024-04-26 15:06:03.644491] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:51.079 [2024-04-26 15:06:03.644500] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.079 [2024-04-26 15:06:03.644504] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:51.079 [2024-04-26 15:06:03.644514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.079 [2024-04-26 15:06:03.644520] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.079 [2024-04-26 15:06:03.644527] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:51.079 [2024-04-26 15:06:03.644532] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:51.079 [2024-04-26 15:06:03.644537] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:51.079 [2024-04-26 15:06:03.644550] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.079 [2024-04-26 15:06:03.644555] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.079 [2024-04-26 15:06:04.228857] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:51.079 [2024-04-26 15:06:04.647032] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:51.079 [2024-04-26 15:06:04.647043] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.079 [2024-04-26 15:06:04.647048] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:51.079 [2024-04-26 15:06:04.647058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.079 [2024-04-26 15:06:04.647063] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.079 [2024-04-26 15:06:04.647071] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:51.079 [2024-04-26 15:06:04.647075] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:51.079 [2024-04-26 15:06:04.647080] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:51.079 [2024-04-26 15:06:04.647096] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.079 [2024-04-26 15:06:04.647101] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.079 [2024-04-26 15:06:05.649588] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:19:51.079 [2024-04-26 15:06:05.649617] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.079 [2024-04-26 15:06:05.649622] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:51.079 [2024-04-26 15:06:05.649633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.079 [2024-04-26 15:06:05.649639] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.079 [2024-04-26 15:06:05.649647] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:51.079 [2024-04-26 15:06:05.649651] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:51.080 [2024-04-26 15:06:05.649657] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:51.080 [2024-04-26 15:06:05.649671] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.080 [2024-04-26 15:06:05.649677] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.080 [2024-04-26 15:06:07.654467] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.080 [2024-04-26 15:06:07.654495] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:51.080 [2024-04-26 15:06:07.654512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.080 [2024-04-26 15:06:07.654518] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.080 [2024-04-26 15:06:07.654534] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:51.080 [2024-04-26 15:06:07.654539] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:51.080 [2024-04-26 15:06:07.654545] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:51.080 [2024-04-26 15:06:07.654564] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.080 [2024-04-26 15:06:07.654569] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.080 [2024-04-26 15:06:09.659566] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:19:51.080 [2024-04-26 15:06:09.659595] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:19:51.080 [2024-04-26 15:06:09.659612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:51.080 [2024-04-26 15:06:09.659618] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:19:51.080 [2024-04-26 15:06:09.659627] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:19:51.080 [2024-04-26 15:06:09.659632] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:19:51.080 [2024-04-26 15:06:09.659638] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:19:51.080 [2024-04-26 15:06:09.659662] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:19:51.080 [2024-04-26 15:06:09.659668] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:19:51.080 [2024-04-26 15:06:10.711051] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:51.080 00:19:51.080 Latency(us) 00:19:51.080 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:51.080 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:51.080 Verification LBA range: start 0x0 length 0x8000 00:19:51.080 Nvme_mlx_0_0n1 : 90.01 11203.77 43.76 0.00 0.00 11406.11 648.53 10066329.60 00:19:51.080 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:51.080 Verification LBA range: start 0x0 length 0x8000 00:19:51.080 Nvme_mlx_0_1n1 : 90.01 10566.15 41.27 0.00 0.00 12093.59 2703.36 9059696.64 00:19:51.080 =================================================================================================================== 00:19:51.080 Total : 21769.91 85.04 0.00 0.00 11739.79 648.53 10066329.60 00:19:51.080 Received shutdown signal, test time was about 90.000000 seconds 00:19:51.080 00:19:51.080 Latency(us) 00:19:51.080 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:51.080 =================================================================================================================== 00:19:51.080 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:51.080 15:07:20 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:19:51.080 15:07:20 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:19:51.080 15:07:20 -- target/device_removal.sh@202 -- # killprocess 3535674 00:19:51.080 15:07:20 -- common/autotest_common.sh@946 -- # '[' -z 3535674 ']' 00:19:51.080 15:07:20 -- common/autotest_common.sh@950 -- # kill -0 3535674 00:19:51.080 15:07:20 -- common/autotest_common.sh@951 -- # uname 00:19:51.080 15:07:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:51.080 15:07:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3535674 00:19:51.080 15:07:20 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:19:51.080 15:07:20 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:19:51.080 15:07:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3535674' 00:19:51.080 killing process with pid 3535674 00:19:51.080 15:07:20 -- common/autotest_common.sh@965 -- # kill 3535674 00:19:51.080 15:07:20 -- common/autotest_common.sh@970 -- # wait 3535674 00:19:51.080 [2024-04-26 15:07:20.640824] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:51.080 15:07:20 -- target/device_removal.sh@203 -- # nvmfpid= 00:19:51.080 15:07:20 -- target/device_removal.sh@205 -- # return 0 00:19:51.080 00:19:51.080 real 1m33.055s 00:19:51.080 user 4m27.698s 00:19:51.080 sys 0m4.405s 00:19:51.080 15:07:20 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:51.080 15:07:20 -- common/autotest_common.sh@10 -- # set +x 00:19:51.080 ************************************ 00:19:51.080 END TEST nvmf_device_removal_pci_remove 00:19:51.080 ************************************ 00:19:51.080 15:07:20 -- target/device_removal.sh@317 -- # nvmftestfini 00:19:51.080 15:07:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:51.080 15:07:20 -- nvmf/common.sh@117 -- # sync 00:19:51.080 15:07:20 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:51.080 15:07:20 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:51.080 15:07:20 -- nvmf/common.sh@120 -- # set +e 00:19:51.080 15:07:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:51.080 15:07:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:51.080 rmmod nvme_rdma 00:19:51.080 rmmod nvme_fabrics 00:19:51.080 15:07:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:51.080 15:07:20 -- nvmf/common.sh@124 -- # set -e 00:19:51.080 15:07:20 -- nvmf/common.sh@125 -- # return 0 00:19:51.080 15:07:20 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:51.080 15:07:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:51.080 15:07:20 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:51.080 15:07:20 -- target/device_removal.sh@318 -- # clean_bond_device 00:19:51.080 15:07:20 -- target/device_removal.sh@240 -- # ip link 00:19:51.080 15:07:20 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:19:51.080 00:19:51.080 real 3m13.738s 00:19:51.080 user 8m57.556s 00:19:51.080 sys 0m14.186s 00:19:51.080 15:07:20 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:51.080 15:07:20 -- common/autotest_common.sh@10 -- # set +x 00:19:51.080 ************************************ 00:19:51.080 END TEST nvmf_device_removal 00:19:51.080 ************************************ 00:19:51.080 15:07:20 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:19:51.080 15:07:20 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:19:51.080 15:07:20 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:19:51.080 15:07:20 -- common/autotest_common.sh@10 -- # set +x 00:19:51.080 ************************************ 00:19:51.080 START TEST nvmf_srq_overwhelm 00:19:51.080 ************************************ 00:19:51.080 15:07:21 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:19:51.080 * Looking for test storage... 00:19:51.080 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:51.080 15:07:21 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:51.080 15:07:21 -- nvmf/common.sh@7 -- # uname -s 00:19:51.080 15:07:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:51.080 15:07:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:51.080 15:07:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:51.080 15:07:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:51.080 15:07:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:51.080 15:07:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:51.080 15:07:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:51.080 15:07:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:51.080 15:07:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:51.080 15:07:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:51.080 15:07:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:51.080 15:07:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:19:51.080 15:07:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:51.080 15:07:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:51.080 15:07:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:51.080 15:07:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:51.080 15:07:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:51.080 15:07:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:51.080 15:07:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:51.080 15:07:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:51.080 15:07:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:51.080 15:07:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:51.081 15:07:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:51.081 15:07:21 -- paths/export.sh@5 -- # export PATH 00:19:51.081 15:07:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:51.081 15:07:21 -- nvmf/common.sh@47 -- # : 0 00:19:51.081 15:07:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:51.081 15:07:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:51.081 15:07:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:51.081 15:07:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:51.081 15:07:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:51.081 15:07:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:51.081 15:07:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:51.081 15:07:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:51.081 15:07:21 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:51.081 15:07:21 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:51.081 15:07:21 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:19:51.081 15:07:21 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:19:51.081 15:07:21 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:51.081 15:07:21 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:51.081 15:07:21 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:51.081 15:07:21 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:51.081 15:07:21 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:51.081 15:07:21 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:51.081 15:07:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:51.081 15:07:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:51.081 15:07:21 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:51.081 15:07:21 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:51.081 15:07:21 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:51.081 15:07:21 -- common/autotest_common.sh@10 -- # set +x 00:19:51.081 15:07:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:51.081 15:07:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:51.081 15:07:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:51.081 15:07:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:51.081 15:07:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:51.081 15:07:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:51.081 15:07:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:51.081 15:07:27 -- nvmf/common.sh@295 -- # net_devs=() 00:19:51.081 15:07:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:51.081 15:07:27 -- nvmf/common.sh@296 -- # e810=() 00:19:51.081 15:07:27 -- nvmf/common.sh@296 -- # local -ga e810 00:19:51.081 15:07:27 -- nvmf/common.sh@297 -- # x722=() 00:19:51.081 15:07:27 -- nvmf/common.sh@297 -- # local -ga x722 00:19:51.081 15:07:27 -- nvmf/common.sh@298 -- # mlx=() 00:19:51.081 15:07:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:51.081 15:07:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:51.081 15:07:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:19:51.081 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:19:51.081 15:07:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:51.081 15:07:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:19:51.081 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:19:51.081 15:07:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:51.081 15:07:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.081 15:07:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.081 15:07:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:19:51.081 Found net devices under 0000:31:00.0: mlx_0_0 00:19:51.081 15:07:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.081 15:07:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.081 15:07:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:19:51.081 Found net devices under 0000:31:00.1: mlx_0_1 00:19:51.081 15:07:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.081 15:07:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:51.081 15:07:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:51.081 15:07:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:51.081 15:07:27 -- nvmf/common.sh@58 -- # uname 00:19:51.081 15:07:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:51.081 15:07:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:51.081 15:07:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:51.081 15:07:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:51.081 15:07:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:51.081 15:07:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:51.081 15:07:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:51.081 15:07:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:51.081 15:07:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:51.081 15:07:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:51.081 15:07:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:51.081 15:07:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:51.081 15:07:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:51.081 15:07:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:51.081 15:07:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:51.081 15:07:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:51.081 15:07:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:51.081 15:07:27 -- nvmf/common.sh@105 -- # continue 2 00:19:51.081 15:07:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.081 15:07:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:51.081 15:07:27 -- nvmf/common.sh@105 -- # continue 2 00:19:51.081 15:07:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:51.081 15:07:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:51.081 15:07:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.081 15:07:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:51.081 15:07:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:51.081 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:51.081 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:19:51.081 altname enp49s0f0np0 00:19:51.081 altname ens786f0np0 00:19:51.081 inet 192.168.100.8/24 scope global mlx_0_0 00:19:51.081 valid_lft forever preferred_lft forever 00:19:51.081 15:07:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:51.081 15:07:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:51.081 15:07:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.081 15:07:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.081 15:07:27 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:51.081 15:07:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:51.081 15:07:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:51.081 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:51.081 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:19:51.081 altname enp49s0f1np1 00:19:51.081 altname ens786f1np1 00:19:51.082 inet 192.168.100.9/24 scope global mlx_0_1 00:19:51.082 valid_lft forever preferred_lft forever 00:19:51.082 15:07:27 -- nvmf/common.sh@411 -- # return 0 00:19:51.082 15:07:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:51.082 15:07:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:51.082 15:07:27 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:51.082 15:07:27 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:51.082 15:07:27 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:51.082 15:07:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:51.082 15:07:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:51.082 15:07:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:51.082 15:07:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:51.082 15:07:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:51.082 15:07:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.082 15:07:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.082 15:07:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:51.082 15:07:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:51.082 15:07:28 -- nvmf/common.sh@105 -- # continue 2 00:19:51.082 15:07:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.082 15:07:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.082 15:07:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:51.082 15:07:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.082 15:07:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:51.082 15:07:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:51.082 15:07:28 -- nvmf/common.sh@105 -- # continue 2 00:19:51.082 15:07:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:51.082 15:07:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:51.082 15:07:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.082 15:07:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:51.082 15:07:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:51.082 15:07:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.082 15:07:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.082 15:07:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:51.082 192.168.100.9' 00:19:51.082 15:07:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:51.082 192.168.100.9' 00:19:51.082 15:07:28 -- nvmf/common.sh@446 -- # head -n 1 00:19:51.082 15:07:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:51.082 15:07:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:51.082 192.168.100.9' 00:19:51.082 15:07:28 -- nvmf/common.sh@447 -- # tail -n +2 00:19:51.082 15:07:28 -- nvmf/common.sh@447 -- # head -n 1 00:19:51.082 15:07:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:51.082 15:07:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:51.082 15:07:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:51.082 15:07:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:51.082 15:07:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:51.082 15:07:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:51.082 15:07:28 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:19:51.082 15:07:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:51.082 15:07:28 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:51.082 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 15:07:28 -- nvmf/common.sh@470 -- # nvmfpid=3558206 00:19:51.082 15:07:28 -- nvmf/common.sh@471 -- # waitforlisten 3558206 00:19:51.082 15:07:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:51.082 15:07:28 -- common/autotest_common.sh@827 -- # '[' -z 3558206 ']' 00:19:51.082 15:07:28 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:51.082 15:07:28 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:51.082 15:07:28 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:51.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:51.082 15:07:28 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:51.082 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 [2024-04-26 15:07:28.138001] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:19:51.082 [2024-04-26 15:07:28.138067] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:51.082 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.082 [2024-04-26 15:07:28.202636] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:51.082 [2024-04-26 15:07:28.274908] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:51.082 [2024-04-26 15:07:28.274948] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:51.082 [2024-04-26 15:07:28.274960] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:51.082 [2024-04-26 15:07:28.274967] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:51.082 [2024-04-26 15:07:28.274974] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:51.082 [2024-04-26 15:07:28.275123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:51.082 [2024-04-26 15:07:28.275249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:51.082 [2024-04-26 15:07:28.275383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:51.082 [2024-04-26 15:07:28.275536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:51.082 15:07:28 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:51.082 15:07:28 -- common/autotest_common.sh@860 -- # return 0 00:19:51.082 15:07:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:51.082 15:07:28 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:51.082 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 15:07:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:51.082 15:07:28 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:19:51.082 15:07:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.082 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 [2024-04-26 15:07:29.003056] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2186b00/0x218aff0) succeed. 00:19:51.082 [2024-04-26 15:07:29.016468] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2188140/0x21cc680) succeed. 00:19:51.082 15:07:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:19:51.082 15:07:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.082 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 15:07:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:51.082 15:07:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.082 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 Malloc0 00:19:51.082 15:07:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:19:51.082 15:07:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.082 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 15:07:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:51.082 15:07:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.082 15:07:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.082 [2024-04-26 15:07:29.120780] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:51.082 15:07:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.082 15:07:29 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:19:54.398 15:07:34 -- common/autotest_common.sh@1231 -- # local i=0 00:19:54.398 15:07:34 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:19:54.398 15:07:34 -- common/autotest_common.sh@1232 -- # grep -q -w nvme0n1 00:19:54.398 15:07:34 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:19:54.398 15:07:34 -- common/autotest_common.sh@1238 -- # grep -q -w nvme0n1 00:19:54.398 15:07:34 -- common/autotest_common.sh@1242 -- # return 0 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:54.398 15:07:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:54.398 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:19:54.398 15:07:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:54.398 15:07:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:54.398 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:19:54.398 Malloc1 00:19:54.398 15:07:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:54.398 15:07:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:54.398 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:19:54.398 15:07:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:54.398 15:07:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:54.398 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:19:54.398 15:07:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:54.398 15:07:34 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:20:00.994 15:07:40 -- common/autotest_common.sh@1231 -- # local i=0 00:20:00.994 15:07:40 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:20:00.994 15:07:40 -- common/autotest_common.sh@1232 -- # grep -q -w nvme1n1 00:20:00.994 15:07:40 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:20:00.994 15:07:40 -- common/autotest_common.sh@1238 -- # grep -q -w nvme1n1 00:20:00.994 15:07:40 -- common/autotest_common.sh@1242 -- # return 0 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:20:00.994 15:07:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:00.994 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.994 15:07:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:20:00.994 15:07:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:00.994 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.994 Malloc2 00:20:00.994 15:07:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:20:00.994 15:07:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:00.994 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.994 15:07:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:20:00.994 15:07:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:00.994 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:20:00.994 15:07:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:00.994 15:07:40 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:20:06.285 15:07:46 -- common/autotest_common.sh@1231 -- # local i=0 00:20:06.285 15:07:46 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:20:06.285 15:07:46 -- common/autotest_common.sh@1232 -- # grep -q -w nvme2n1 00:20:06.285 15:07:46 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:20:06.285 15:07:46 -- common/autotest_common.sh@1238 -- # grep -q -w nvme2n1 00:20:06.285 15:07:46 -- common/autotest_common.sh@1242 -- # return 0 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:20:06.285 15:07:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:06.285 15:07:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.285 15:07:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:20:06.285 15:07:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:06.285 15:07:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.285 Malloc3 00:20:06.285 15:07:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:20:06.285 15:07:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:06.285 15:07:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.285 15:07:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:20:06.285 15:07:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:06.285 15:07:46 -- common/autotest_common.sh@10 -- # set +x 00:20:06.285 15:07:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:06.285 15:07:46 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:20:11.578 15:07:51 -- common/autotest_common.sh@1231 -- # local i=0 00:20:11.578 15:07:51 -- common/autotest_common.sh@1232 -- # grep -q -w nvme3n1 00:20:11.578 15:07:51 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:20:11.578 15:07:51 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:20:11.578 15:07:51 -- common/autotest_common.sh@1238 -- # grep -q -w nvme3n1 00:20:11.578 15:07:51 -- common/autotest_common.sh@1242 -- # return 0 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:20:11.578 15:07:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:11.578 15:07:51 -- common/autotest_common.sh@10 -- # set +x 00:20:11.578 15:07:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:20:11.578 15:07:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:11.578 15:07:51 -- common/autotest_common.sh@10 -- # set +x 00:20:11.578 Malloc4 00:20:11.578 15:07:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:20:11.578 15:07:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:11.578 15:07:51 -- common/autotest_common.sh@10 -- # set +x 00:20:11.578 15:07:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:20:11.578 15:07:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:11.578 15:07:51 -- common/autotest_common.sh@10 -- # set +x 00:20:11.578 15:07:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:11.578 15:07:51 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:20:16.871 15:07:57 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:20:16.871 15:07:57 -- common/autotest_common.sh@1231 -- # local i=0 00:20:16.871 15:07:57 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:20:16.871 15:07:57 -- common/autotest_common.sh@1232 -- # grep -q -w nvme4n1 00:20:16.871 15:07:57 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:20:16.871 15:07:57 -- common/autotest_common.sh@1238 -- # grep -q -w nvme4n1 00:20:16.871 15:07:57 -- common/autotest_common.sh@1242 -- # return 0 00:20:16.871 15:07:57 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:20:16.871 15:07:57 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:20:16.871 15:07:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:16.871 15:07:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.871 15:07:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:16.871 15:07:57 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:20:16.871 15:07:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:16.872 15:07:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.872 Malloc5 00:20:16.872 15:07:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:16.872 15:07:57 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:20:16.872 15:07:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:16.872 15:07:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.872 15:07:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:16.872 15:07:57 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:20:16.872 15:07:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:16.872 15:07:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.872 15:07:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:16.872 15:07:57 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:20:21.082 15:08:01 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:20:21.082 15:08:01 -- common/autotest_common.sh@1231 -- # local i=0 00:20:21.082 15:08:01 -- common/autotest_common.sh@1232 -- # grep -q -w nvme5n1 00:20:21.082 15:08:01 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:20:21.082 15:08:01 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:20:21.082 15:08:01 -- common/autotest_common.sh@1238 -- # grep -q -w nvme5n1 00:20:21.082 15:08:01 -- common/autotest_common.sh@1242 -- # return 0 00:20:21.082 15:08:01 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:20:21.082 [global] 00:20:21.082 thread=1 00:20:21.082 invalidate=1 00:20:21.082 rw=read 00:20:21.082 time_based=1 00:20:21.082 runtime=10 00:20:21.082 ioengine=libaio 00:20:21.082 direct=1 00:20:21.082 bs=1048576 00:20:21.082 iodepth=128 00:20:21.082 norandommap=1 00:20:21.082 numjobs=13 00:20:21.082 00:20:21.082 [job0] 00:20:21.082 filename=/dev/nvme0n1 00:20:21.082 [job1] 00:20:21.082 filename=/dev/nvme1n1 00:20:21.082 [job2] 00:20:21.082 filename=/dev/nvme2n1 00:20:21.082 [job3] 00:20:21.082 filename=/dev/nvme3n1 00:20:21.082 [job4] 00:20:21.082 filename=/dev/nvme4n1 00:20:21.082 [job5] 00:20:21.082 filename=/dev/nvme5n1 00:20:21.366 Could not set queue depth (nvme0n1) 00:20:21.366 Could not set queue depth (nvme1n1) 00:20:21.366 Could not set queue depth (nvme2n1) 00:20:21.366 Could not set queue depth (nvme3n1) 00:20:21.366 Could not set queue depth (nvme4n1) 00:20:21.366 Could not set queue depth (nvme5n1) 00:20:21.628 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:20:21.628 ... 00:20:21.628 fio-3.35 00:20:21.628 Starting 78 threads 00:20:33.859 00:20:33.859 job0: (groupid=0, jobs=1): err= 0: pid=3565204: Fri Apr 26 15:08:14 2024 00:20:33.859 read: IOPS=42, BW=42.9MiB/s (45.0MB/s)(454MiB/10582msec) 00:20:33.859 slat (usec): min=23, max=1951.8k, avg=23218.03, stdev=142220.31 00:20:33.859 clat (msec): min=38, max=6073, avg=2652.93, stdev=1742.59 00:20:33.859 lat (msec): min=1066, max=6183, avg=2676.15, stdev=1740.73 00:20:33.859 clat percentiles (msec): 00:20:33.859 | 1.00th=[ 1070], 5.00th=[ 1167], 10.00th=[ 1234], 20.00th=[ 1351], 00:20:33.859 | 30.00th=[ 1519], 40.00th=[ 1703], 50.00th=[ 1838], 60.00th=[ 1921], 00:20:33.859 | 70.00th=[ 2198], 80.00th=[ 5470], 90.00th=[ 5738], 95.00th=[ 5940], 00:20:33.859 | 99.00th=[ 6007], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], 00:20:33.859 | 99.99th=[ 6074] 00:20:33.859 bw ( KiB/s): min= 8192, max=141312, per=1.66%, avg=60679.27, stdev=36990.39, samples=11 00:20:33.859 iops : min= 8, max= 138, avg=59.18, stdev=36.06, samples=11 00:20:33.859 lat (msec) : 50=0.22%, 2000=64.98%, >=2000=34.80% 00:20:33.859 cpu : usr=0.01%, sys=0.88%, ctx=1072, majf=0, minf=32769 00:20:33.859 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.5%, 32=7.0%, >=64=86.1% 00:20:33.859 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.859 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.859 issued rwts: total=454,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.859 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.859 job0: (groupid=0, jobs=1): err= 0: pid=3565205: Fri Apr 26 15:08:14 2024 00:20:33.859 read: IOPS=12, BW=12.9MiB/s (13.5MB/s)(135MiB/10497msec) 00:20:33.859 slat (usec): min=66, max=2103.4k, avg=77397.18, stdev=375027.69 00:20:33.859 clat (msec): min=47, max=10486, avg=6607.88, stdev=3234.38 00:20:33.859 lat (msec): min=2027, max=10487, avg=6685.28, stdev=3201.03 00:20:33.859 clat percentiles (msec): 00:20:33.859 | 1.00th=[ 2022], 5.00th=[ 2039], 10.00th=[ 2123], 20.00th=[ 2123], 00:20:33.859 | 30.00th=[ 4245], 40.00th=[ 4329], 50.00th=[ 8423], 60.00th=[ 8490], 00:20:33.859 | 70.00th=[ 8557], 80.00th=[10402], 90.00th=[10402], 95.00th=[10537], 00:20:33.859 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.859 | 99.99th=[10537] 00:20:33.859 bw ( KiB/s): min=14336, max=14336, per=0.39%, avg=14336.00, stdev= 0.00, samples=1 00:20:33.859 iops : min= 14, max= 14, avg=14.00, stdev= 0.00, samples=1 00:20:33.859 lat (msec) : 50=0.74%, >=2000=99.26% 00:20:33.859 cpu : usr=0.00%, sys=0.74%, ctx=89, majf=0, minf=32769 00:20:33.859 IO depths : 1=0.7%, 2=1.5%, 4=3.0%, 8=5.9%, 16=11.9%, 32=23.7%, >=64=53.3% 00:20:33.859 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.859 complete : 0=0.0%, 4=88.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=11.1% 00:20:33.859 issued rwts: total=135,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.859 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.859 job0: (groupid=0, jobs=1): err= 0: pid=3565206: Fri Apr 26 15:08:14 2024 00:20:33.859 read: IOPS=104, BW=105MiB/s (110MB/s)(1049MiB/10038msec) 00:20:33.859 slat (usec): min=23, max=129004, avg=9529.80, stdev=21326.28 00:20:33.859 clat (msec): min=35, max=2169, avg=1104.80, stdev=581.06 00:20:33.859 lat (msec): min=44, max=2173, avg=1114.33, stdev=584.34 00:20:33.859 clat percentiles (msec): 00:20:33.859 | 1.00th=[ 51], 5.00th=[ 330], 10.00th=[ 351], 20.00th=[ 550], 00:20:33.859 | 30.00th=[ 676], 40.00th=[ 776], 50.00th=[ 995], 60.00th=[ 1318], 00:20:33.859 | 70.00th=[ 1636], 80.00th=[ 1720], 90.00th=[ 1854], 95.00th=[ 1955], 00:20:33.859 | 99.00th=[ 2089], 99.50th=[ 2106], 99.90th=[ 2165], 99.95th=[ 2165], 00:20:33.859 | 99.99th=[ 2165] 00:20:33.860 bw ( KiB/s): min=10240, max=346112, per=3.04%, avg=111041.18, stdev=78601.20, samples=17 00:20:33.860 iops : min= 10, max= 338, avg=108.35, stdev=76.79, samples=17 00:20:33.860 lat (msec) : 50=0.86%, 100=0.57%, 250=1.62%, 500=13.92%, 750=21.54% 00:20:33.860 lat (msec) : 1000=11.73%, 2000=46.23%, >=2000=3.53% 00:20:33.860 cpu : usr=0.05%, sys=1.33%, ctx=1911, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.1%, >=64=94.0% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.860 issued rwts: total=1049,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565207: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=68, BW=68.1MiB/s (71.5MB/s)(712MiB/10449msec) 00:20:33.860 slat (usec): min=31, max=2001.1k, avg=14618.81, stdev=117153.90 00:20:33.860 clat (msec): min=36, max=6754, avg=1752.23, stdev=2044.52 00:20:33.860 lat (msec): min=181, max=6788, avg=1766.85, stdev=2050.69 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 186], 5.00th=[ 222], 10.00th=[ 259], 20.00th=[ 376], 00:20:33.860 | 30.00th=[ 468], 40.00th=[ 542], 50.00th=[ 1045], 60.00th=[ 1301], 00:20:33.860 | 70.00th=[ 1469], 80.00th=[ 1670], 90.00th=[ 6007], 95.00th=[ 6275], 00:20:33.860 | 99.00th=[ 6678], 99.50th=[ 6745], 99.90th=[ 6745], 99.95th=[ 6745], 00:20:33.860 | 99.99th=[ 6745] 00:20:33.860 bw ( KiB/s): min=10240, max=335872, per=3.27%, avg=119603.20, stdev=119679.86, samples=10 00:20:33.860 iops : min= 10, max= 328, avg=116.80, stdev=116.87, samples=10 00:20:33.860 lat (msec) : 50=0.14%, 250=8.43%, 500=28.37%, 750=7.58%, 1000=4.35% 00:20:33.860 lat (msec) : 2000=31.88%, >=2000=19.24% 00:20:33.860 cpu : usr=0.02%, sys=1.00%, ctx=1519, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.860 issued rwts: total=712,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565208: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=30, BW=30.5MiB/s (32.0MB/s)(319MiB/10444msec) 00:20:33.860 slat (usec): min=25, max=1977.3k, avg=32616.22, stdev=187218.17 00:20:33.860 clat (msec): min=37, max=7255, avg=3773.05, stdev=2326.63 00:20:33.860 lat (msec): min=1408, max=7280, avg=3805.67, stdev=2317.90 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 1418], 5.00th=[ 1536], 10.00th=[ 1670], 20.00th=[ 1770], 00:20:33.860 | 30.00th=[ 1921], 40.00th=[ 2056], 50.00th=[ 2165], 60.00th=[ 3306], 00:20:33.860 | 70.00th=[ 6275], 80.00th=[ 6678], 90.00th=[ 7148], 95.00th=[ 7148], 00:20:33.860 | 99.00th=[ 7215], 99.50th=[ 7215], 99.90th=[ 7282], 99.95th=[ 7282], 00:20:33.860 | 99.99th=[ 7282] 00:20:33.860 bw ( KiB/s): min= 8192, max=112640, per=1.53%, avg=55881.14, stdev=35839.30, samples=7 00:20:33.860 iops : min= 8, max= 110, avg=54.57, stdev=35.00, samples=7 00:20:33.860 lat (msec) : 50=0.31%, 2000=36.36%, >=2000=63.32% 00:20:33.860 cpu : usr=0.02%, sys=0.76%, ctx=1011, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.5%, 16=5.0%, 32=10.0%, >=64=80.3% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.860 issued rwts: total=319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565209: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=9, BW=9.78MiB/s (10.3MB/s)(104MiB/10629msec) 00:20:33.860 slat (usec): min=253, max=2111.6k, avg=101827.78, stdev=395241.39 00:20:33.860 clat (msec): min=37, max=10619, avg=8875.40, stdev=2525.63 00:20:33.860 lat (msec): min=1984, max=10628, avg=8977.23, stdev=2374.84 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 1989], 5.00th=[ 2123], 10.00th=[ 4212], 20.00th=[ 6409], 00:20:33.860 | 30.00th=[ 9194], 40.00th=[ 9463], 50.00th=[ 9866], 60.00th=[10402], 00:20:33.860 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10537], 95.00th=[10671], 00:20:33.860 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:20:33.860 | 99.99th=[10671] 00:20:33.860 lat (msec) : 50=0.96%, 2000=0.96%, >=2000=98.08% 00:20:33.860 cpu : usr=0.00%, sys=0.83%, ctx=256, majf=0, minf=26625 00:20:33.860 IO depths : 1=1.0%, 2=1.9%, 4=3.8%, 8=7.7%, 16=15.4%, 32=30.8%, >=64=39.4% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:20:33.860 issued rwts: total=104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565210: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=22, BW=22.9MiB/s (24.0MB/s)(242MiB/10587msec) 00:20:33.860 slat (usec): min=31, max=2117.5k, avg=43594.59, stdev=246578.64 00:20:33.860 clat (msec): min=35, max=8304, avg=4501.37, stdev=2640.37 00:20:33.860 lat (msec): min=1682, max=8416, avg=4544.97, stdev=2641.24 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 1687], 5.00th=[ 1703], 10.00th=[ 1720], 20.00th=[ 1770], 00:20:33.860 | 30.00th=[ 1838], 40.00th=[ 2022], 50.00th=[ 4279], 60.00th=[ 6812], 00:20:33.860 | 70.00th=[ 7080], 80.00th=[ 7282], 90.00th=[ 7617], 95.00th=[ 7819], 00:20:33.860 | 99.00th=[ 8288], 99.50th=[ 8288], 99.90th=[ 8288], 99.95th=[ 8288], 00:20:33.860 | 99.99th=[ 8288] 00:20:33.860 bw ( KiB/s): min= 6144, max=210944, per=2.13%, avg=77824.00, stdev=115398.94, samples=3 00:20:33.860 iops : min= 6, max= 206, avg=76.00, stdev=112.69, samples=3 00:20:33.860 lat (msec) : 50=0.41%, 2000=39.26%, >=2000=60.33% 00:20:33.860 cpu : usr=0.00%, sys=0.63%, ctx=498, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.4%, 2=0.8%, 4=1.7%, 8=3.3%, 16=6.6%, 32=13.2%, >=64=74.0% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.9% 00:20:33.860 issued rwts: total=242,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565211: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=5, BW=5549KiB/s (5682kB/s)(57.0MiB/10519msec) 00:20:33.860 slat (usec): min=643, max=2107.7k, avg=184278.92, stdev=535253.20 00:20:33.860 clat (msec): min=14, max=10504, avg=8636.78, stdev=2701.60 00:20:33.860 lat (msec): min=2122, max=10518, avg=8821.06, stdev=2449.44 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 15], 5.00th=[ 2123], 10.00th=[ 4144], 20.00th=[ 8288], 00:20:33.860 | 30.00th=[ 8423], 40.00th=[ 8557], 50.00th=[10000], 60.00th=[10402], 00:20:33.860 | 70.00th=[10402], 80.00th=[10537], 90.00th=[10537], 95.00th=[10537], 00:20:33.860 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.860 | 99.99th=[10537] 00:20:33.860 lat (msec) : 20=1.75%, >=2000=98.25% 00:20:33.860 cpu : usr=0.02%, sys=0.29%, ctx=183, majf=0, minf=14593 00:20:33.860 IO depths : 1=1.8%, 2=3.5%, 4=7.0%, 8=14.0%, 16=28.1%, 32=45.6%, >=64=0.0% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:20:33.860 issued rwts: total=57,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565213: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=73, BW=73.1MiB/s (76.7MB/s)(738MiB/10089msec) 00:20:33.860 slat (usec): min=30, max=1804.2k, avg=13569.35, stdev=69173.87 00:20:33.860 clat (msec): min=70, max=3871, avg=1633.00, stdev=939.90 00:20:33.860 lat (msec): min=122, max=3898, avg=1646.57, stdev=942.49 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 201], 5.00th=[ 531], 10.00th=[ 726], 20.00th=[ 1020], 00:20:33.860 | 30.00th=[ 1217], 40.00th=[ 1334], 50.00th=[ 1401], 60.00th=[ 1469], 00:20:33.860 | 70.00th=[ 1552], 80.00th=[ 1687], 90.00th=[ 3540], 95.00th=[ 3608], 00:20:33.860 | 99.00th=[ 3842], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], 00:20:33.860 | 99.99th=[ 3876] 00:20:33.860 bw ( KiB/s): min= 6144, max=141312, per=2.13%, avg=77789.25, stdev=37343.24, samples=16 00:20:33.860 iops : min= 6, max= 138, avg=75.94, stdev=36.45, samples=16 00:20:33.860 lat (msec) : 100=0.14%, 250=1.22%, 500=2.30%, 750=6.64%, 1000=8.81% 00:20:33.860 lat (msec) : 2000=63.69%, >=2000=17.21% 00:20:33.860 cpu : usr=0.02%, sys=1.36%, ctx=1546, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.2%, 32=4.3%, >=64=91.5% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.860 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.860 issued rwts: total=738,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.860 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.860 job0: (groupid=0, jobs=1): err= 0: pid=3565214: Fri Apr 26 15:08:14 2024 00:20:33.860 read: IOPS=103, BW=104MiB/s (109MB/s)(1101MiB/10600msec) 00:20:33.860 slat (usec): min=25, max=1543.8k, avg=9584.83, stdev=49334.58 00:20:33.860 clat (msec): min=41, max=2577, avg=1072.75, stdev=494.18 00:20:33.860 lat (msec): min=343, max=2580, avg=1082.33, stdev=495.65 00:20:33.860 clat percentiles (msec): 00:20:33.860 | 1.00th=[ 372], 5.00th=[ 397], 10.00th=[ 435], 20.00th=[ 701], 00:20:33.860 | 30.00th=[ 852], 40.00th=[ 919], 50.00th=[ 1003], 60.00th=[ 1099], 00:20:33.860 | 70.00th=[ 1167], 80.00th=[ 1250], 90.00th=[ 1854], 95.00th=[ 2232], 00:20:33.860 | 99.00th=[ 2500], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], 00:20:33.860 | 99.99th=[ 2567] 00:20:33.860 bw ( KiB/s): min= 6144, max=319488, per=3.63%, avg=132809.80, stdev=68131.44, samples=15 00:20:33.860 iops : min= 6, max= 312, avg=129.60, stdev=66.53, samples=15 00:20:33.860 lat (msec) : 50=0.09%, 500=12.26%, 750=9.17%, 1000=28.43%, 2000=41.96% 00:20:33.860 lat (msec) : >=2000=8.08% 00:20:33.860 cpu : usr=0.04%, sys=1.34%, ctx=1820, majf=0, minf=32769 00:20:33.860 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.3% 00:20:33.860 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.861 issued rwts: total=1101,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job0: (groupid=0, jobs=1): err= 0: pid=3565215: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=4, BW=4879KiB/s (4997kB/s)(50.0MiB/10493msec) 00:20:33.861 slat (usec): min=1824, max=2122.2k, avg=209558.54, stdev=569966.80 00:20:33.861 clat (msec): min=14, max=10484, avg=6534.41, stdev=3414.74 00:20:33.861 lat (msec): min=2094, max=10492, avg=6743.97, stdev=3326.84 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 15], 5.00th=[ 2106], 10.00th=[ 2106], 20.00th=[ 2140], 00:20:33.861 | 30.00th=[ 4245], 40.00th=[ 4279], 50.00th=[ 8288], 60.00th=[ 8423], 00:20:33.861 | 70.00th=[ 9731], 80.00th=[10000], 90.00th=[10268], 95.00th=[10537], 00:20:33.861 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.861 | 99.99th=[10537] 00:20:33.861 lat (msec) : 20=2.00%, >=2000=98.00% 00:20:33.861 cpu : usr=0.00%, sys=0.24%, ctx=184, majf=0, minf=12801 00:20:33.861 IO depths : 1=2.0%, 2=4.0%, 4=8.0%, 8=16.0%, 16=32.0%, 32=38.0%, >=64=0.0% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:20:33.861 issued rwts: total=50,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job0: (groupid=0, jobs=1): err= 0: pid=3565216: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=109, BW=109MiB/s (115MB/s)(1097MiB/10044msec) 00:20:33.861 slat (usec): min=24, max=205831, avg=9120.55, stdev=16666.68 00:20:33.861 clat (msec): min=33, max=1747, avg=1071.16, stdev=438.93 00:20:33.861 lat (msec): min=47, max=1751, avg=1080.28, stdev=441.17 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 58], 5.00th=[ 226], 10.00th=[ 456], 20.00th=[ 625], 00:20:33.861 | 30.00th=[ 760], 40.00th=[ 1062], 50.00th=[ 1200], 60.00th=[ 1267], 00:20:33.861 | 70.00th=[ 1334], 80.00th=[ 1452], 90.00th=[ 1603], 95.00th=[ 1687], 00:20:33.861 | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1754], 99.95th=[ 1754], 00:20:33.861 | 99.99th=[ 1754] 00:20:33.861 bw ( KiB/s): min=24576, max=225280, per=3.18%, avg=116171.65, stdev=54768.72, samples=17 00:20:33.861 iops : min= 24, max= 220, avg=113.41, stdev=53.41, samples=17 00:20:33.861 lat (msec) : 50=0.18%, 100=1.64%, 250=3.83%, 500=4.83%, 750=18.96% 00:20:33.861 lat (msec) : 1000=7.84%, 2000=62.72% 00:20:33.861 cpu : usr=0.05%, sys=1.44%, ctx=2368, majf=0, minf=32769 00:20:33.861 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.3% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.861 issued rwts: total=1097,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job0: (groupid=0, jobs=1): err= 0: pid=3565217: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=149, BW=149MiB/s (157MB/s)(1507MiB/10092msec) 00:20:33.861 slat (usec): min=24, max=119967, avg=6643.80, stdev=14792.84 00:20:33.861 clat (msec): min=73, max=2033, avg=804.71, stdev=407.35 00:20:33.861 lat (msec): min=102, max=2036, avg=811.35, stdev=409.13 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 133], 5.00th=[ 163], 10.00th=[ 251], 20.00th=[ 418], 00:20:33.861 | 30.00th=[ 617], 40.00th=[ 709], 50.00th=[ 802], 60.00th=[ 877], 00:20:33.861 | 70.00th=[ 978], 80.00th=[ 1062], 90.00th=[ 1267], 95.00th=[ 1603], 00:20:33.861 | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 2039], 99.95th=[ 2039], 00:20:33.861 | 99.99th=[ 2039] 00:20:33.861 bw ( KiB/s): min=43008, max=444416, per=4.06%, avg=148510.32, stdev=101924.17, samples=19 00:20:33.861 iops : min= 42, max= 434, avg=145.00, stdev=99.56, samples=19 00:20:33.861 lat (msec) : 100=0.07%, 250=9.69%, 500=13.01%, 750=19.24%, 1000=29.53% 00:20:33.861 lat (msec) : 2000=28.20%, >=2000=0.27% 00:20:33.861 cpu : usr=0.08%, sys=1.59%, ctx=2561, majf=0, minf=32769 00:20:33.861 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.1%, 32=2.1%, >=64=95.8% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.861 issued rwts: total=1507,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job1: (groupid=0, jobs=1): err= 0: pid=3565230: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=68, BW=68.9MiB/s (72.2MB/s)(691MiB/10030msec) 00:20:33.861 slat (usec): min=24, max=2151.4k, avg=14471.76, stdev=139112.86 00:20:33.861 clat (msec): min=26, max=7050, avg=1710.20, stdev=2451.48 00:20:33.861 lat (msec): min=33, max=7055, avg=1724.67, stdev=2459.64 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 44], 5.00th=[ 101], 10.00th=[ 257], 20.00th=[ 334], 00:20:33.861 | 30.00th=[ 384], 40.00th=[ 456], 50.00th=[ 531], 60.00th=[ 584], 00:20:33.861 | 70.00th=[ 1003], 80.00th=[ 2635], 90.00th=[ 6946], 95.00th=[ 7013], 00:20:33.861 | 99.00th=[ 7013], 99.50th=[ 7013], 99.90th=[ 7080], 99.95th=[ 7080], 00:20:33.861 | 99.99th=[ 7080] 00:20:33.861 bw ( KiB/s): min=12288, max=342016, per=3.94%, avg=144142.12, stdev=130097.25, samples=8 00:20:33.861 iops : min= 12, max= 334, avg=140.75, stdev=127.04, samples=8 00:20:33.861 lat (msec) : 50=2.03%, 100=2.89%, 250=4.49%, 500=38.78%, 750=15.63% 00:20:33.861 lat (msec) : 1000=6.51%, 2000=9.41%, >=2000=20.26% 00:20:33.861 cpu : usr=0.01%, sys=1.26%, ctx=910, majf=0, minf=32769 00:20:33.861 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.861 issued rwts: total=691,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job1: (groupid=0, jobs=1): err= 0: pid=3565231: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=60, BW=60.9MiB/s (63.8MB/s)(609MiB/10008msec) 00:20:33.861 slat (usec): min=23, max=2107.9k, avg=16416.75, stdev=152563.40 00:20:33.861 clat (msec): min=7, max=8573, avg=1125.28, stdev=2004.09 00:20:33.861 lat (msec): min=7, max=8575, avg=1141.70, stdev=2026.54 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 9], 5.00th=[ 31], 10.00th=[ 51], 20.00th=[ 155], 00:20:33.861 | 30.00th=[ 239], 40.00th=[ 376], 50.00th=[ 418], 60.00th=[ 460], 00:20:33.861 | 70.00th=[ 531], 80.00th=[ 625], 90.00th=[ 6275], 95.00th=[ 6611], 00:20:33.861 | 99.00th=[ 6745], 99.50th=[ 8490], 99.90th=[ 8557], 99.95th=[ 8557], 00:20:33.861 | 99.99th=[ 8557] 00:20:33.861 bw ( KiB/s): min=253952, max=276480, per=7.25%, avg=265216.00, stdev=15929.70, samples=2 00:20:33.861 iops : min= 248, max= 270, avg=259.00, stdev=15.56, samples=2 00:20:33.861 lat (msec) : 10=1.64%, 20=1.48%, 50=5.75%, 100=5.09%, 250=18.23% 00:20:33.861 lat (msec) : 500=30.54%, 750=22.50%, >=2000=14.78% 00:20:33.861 cpu : usr=0.02%, sys=0.97%, ctx=854, majf=0, minf=32769 00:20:33.861 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.7% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.861 issued rwts: total=609,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job1: (groupid=0, jobs=1): err= 0: pid=3565232: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=28, BW=28.9MiB/s (30.3MB/s)(335MiB/11605msec) 00:20:33.861 slat (usec): min=33, max=2080.4k, avg=34575.63, stdev=185773.70 00:20:33.861 clat (msec): min=19, max=7561, avg=4129.43, stdev=2085.31 00:20:33.861 lat (msec): min=1219, max=7582, avg=4164.01, stdev=2080.23 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 1250], 5.00th=[ 1401], 10.00th=[ 1989], 20.00th=[ 2232], 00:20:33.861 | 30.00th=[ 2500], 40.00th=[ 2802], 50.00th=[ 3339], 60.00th=[ 3842], 00:20:33.861 | 70.00th=[ 6007], 80.00th=[ 6678], 90.00th=[ 7080], 95.00th=[ 7416], 00:20:33.861 | 99.00th=[ 7550], 99.50th=[ 7550], 99.90th=[ 7550], 99.95th=[ 7550], 00:20:33.861 | 99.99th=[ 7550] 00:20:33.861 bw ( KiB/s): min= 4096, max=96448, per=1.05%, avg=38513.36, stdev=23150.89, samples=11 00:20:33.861 iops : min= 4, max= 94, avg=37.55, stdev=22.57, samples=11 00:20:33.861 lat (msec) : 20=0.30%, 2000=9.85%, >=2000=89.85% 00:20:33.861 cpu : usr=0.01%, sys=0.97%, ctx=634, majf=0, minf=32769 00:20:33.861 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.8%, 32=9.6%, >=64=81.2% 00:20:33.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.861 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.861 issued rwts: total=335,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.861 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.861 job1: (groupid=0, jobs=1): err= 0: pid=3565234: Fri Apr 26 15:08:14 2024 00:20:33.861 read: IOPS=35, BW=35.1MiB/s (36.8MB/s)(408MiB/11613msec) 00:20:33.861 slat (usec): min=28, max=2847.6k, avg=28412.93, stdev=193360.29 00:20:33.861 clat (msec): min=17, max=6047, avg=2182.14, stdev=1157.62 00:20:33.861 lat (msec): min=860, max=6062, avg=2210.55, stdev=1169.12 00:20:33.861 clat percentiles (msec): 00:20:33.861 | 1.00th=[ 869], 5.00th=[ 927], 10.00th=[ 961], 20.00th=[ 1028], 00:20:33.861 | 30.00th=[ 1318], 40.00th=[ 1770], 50.00th=[ 2005], 60.00th=[ 2232], 00:20:33.861 | 70.00th=[ 2702], 80.00th=[ 3004], 90.00th=[ 3675], 95.00th=[ 4111], 00:20:33.861 | 99.00th=[ 6007], 99.50th=[ 6007], 99.90th=[ 6074], 99.95th=[ 6074], 00:20:33.861 | 99.99th=[ 6074] 00:20:33.861 bw ( KiB/s): min=18035, max=124928, per=1.96%, avg=71630.38, stdev=34618.50, samples=8 00:20:33.861 iops : min= 17, max= 122, avg=69.88, stdev=33.94, samples=8 00:20:33.861 lat (msec) : 20=0.25%, 1000=15.93%, 2000=33.09%, >=2000=50.74% 00:20:33.862 cpu : usr=0.02%, sys=0.76%, ctx=658, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=3.9%, 32=7.8%, >=64=84.6% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:20:33.862 issued rwts: total=408,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565235: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=69, BW=69.2MiB/s (72.5MB/s)(695MiB/10050msec) 00:20:33.862 slat (usec): min=24, max=2068.2k, avg=14392.11, stdev=96120.42 00:20:33.862 clat (msec): min=44, max=3003, avg=1491.35, stdev=921.13 00:20:33.862 lat (msec): min=50, max=3014, avg=1505.74, stdev=923.28 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 81], 5.00th=[ 239], 10.00th=[ 523], 20.00th=[ 642], 00:20:33.862 | 30.00th=[ 835], 40.00th=[ 1011], 50.00th=[ 1083], 60.00th=[ 1536], 00:20:33.862 | 70.00th=[ 2299], 80.00th=[ 2567], 90.00th=[ 2869], 95.00th=[ 2903], 00:20:33.862 | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], 00:20:33.862 | 99.99th=[ 3004] 00:20:33.862 bw ( KiB/s): min= 8192, max=251904, per=2.64%, avg=96670.50, stdev=80985.72, samples=12 00:20:33.862 iops : min= 8, max= 246, avg=94.33, stdev=79.06, samples=12 00:20:33.862 lat (msec) : 50=0.14%, 100=1.29%, 250=4.03%, 500=3.31%, 750=18.13% 00:20:33.862 lat (msec) : 1000=12.52%, 2000=25.76%, >=2000=34.82% 00:20:33.862 cpu : usr=0.03%, sys=1.05%, ctx=1059, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.862 issued rwts: total=695,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565236: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=57, BW=57.4MiB/s (60.2MB/s)(578MiB/10072msec) 00:20:33.862 slat (usec): min=28, max=2090.1k, avg=17303.02, stdev=108167.73 00:20:33.862 clat (msec): min=67, max=6471, avg=2140.72, stdev=1953.52 00:20:33.862 lat (msec): min=88, max=6506, avg=2158.03, stdev=1961.59 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 148], 5.00th=[ 342], 10.00th=[ 751], 20.00th=[ 902], 00:20:33.862 | 30.00th=[ 936], 40.00th=[ 953], 50.00th=[ 986], 60.00th=[ 1250], 00:20:33.862 | 70.00th=[ 2232], 80.00th=[ 4866], 90.00th=[ 5671], 95.00th=[ 6275], 00:20:33.862 | 99.00th=[ 6477], 99.50th=[ 6477], 99.90th=[ 6477], 99.95th=[ 6477], 00:20:33.862 | 99.99th=[ 6477] 00:20:33.862 bw ( KiB/s): min= 8192, max=147161, per=1.80%, avg=65953.79, stdev=45994.73, samples=14 00:20:33.862 iops : min= 8, max= 143, avg=64.36, stdev=44.82, samples=14 00:20:33.862 lat (msec) : 100=0.35%, 250=1.90%, 500=3.63%, 750=4.15%, 1000=42.91% 00:20:33.862 lat (msec) : 2000=12.98%, >=2000=34.08% 00:20:33.862 cpu : usr=0.04%, sys=1.48%, ctx=950, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.5%, >=64=89.1% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.862 issued rwts: total=578,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565237: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=62, BW=62.3MiB/s (65.3MB/s)(628MiB/10078msec) 00:20:33.862 slat (usec): min=38, max=1949.7k, avg=15933.21, stdev=105988.75 00:20:33.862 clat (msec): min=68, max=4987, avg=1826.88, stdev=1297.66 00:20:33.862 lat (msec): min=92, max=5007, avg=1842.81, stdev=1302.16 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 186], 5.00th=[ 518], 10.00th=[ 567], 20.00th=[ 651], 00:20:33.862 | 30.00th=[ 852], 40.00th=[ 927], 50.00th=[ 986], 60.00th=[ 2299], 00:20:33.862 | 70.00th=[ 2400], 80.00th=[ 3104], 90.00th=[ 3775], 95.00th=[ 4329], 00:20:33.862 | 99.00th=[ 4933], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], 00:20:33.862 | 99.99th=[ 5000] 00:20:33.862 bw ( KiB/s): min=14336, max=157696, per=2.16%, avg=78920.77, stdev=53883.29, samples=13 00:20:33.862 iops : min= 14, max= 154, avg=77.00, stdev=52.68, samples=13 00:20:33.862 lat (msec) : 100=0.32%, 250=1.43%, 500=2.55%, 750=19.43%, 1000=27.23% 00:20:33.862 lat (msec) : 2000=5.10%, >=2000=43.95% 00:20:33.862 cpu : usr=0.00%, sys=1.57%, ctx=1216, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.1%, >=64=90.0% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.862 issued rwts: total=628,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565238: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=28, BW=28.8MiB/s (30.2MB/s)(304MiB/10563msec) 00:20:33.862 slat (usec): min=35, max=2110.1k, avg=34590.49, stdev=176616.72 00:20:33.862 clat (msec): min=45, max=6207, avg=3742.41, stdev=1706.97 00:20:33.862 lat (msec): min=1704, max=6224, avg=3777.00, stdev=1700.03 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 1737], 5.00th=[ 1787], 10.00th=[ 1854], 20.00th=[ 2123], 00:20:33.862 | 30.00th=[ 2400], 40.00th=[ 2668], 50.00th=[ 3037], 60.00th=[ 3742], 00:20:33.862 | 70.00th=[ 5805], 80.00th=[ 5873], 90.00th=[ 6074], 95.00th=[ 6141], 00:20:33.862 | 99.00th=[ 6141], 99.50th=[ 6208], 99.90th=[ 6208], 99.95th=[ 6208], 00:20:33.862 | 99.99th=[ 6208] 00:20:33.862 bw ( KiB/s): min=16384, max=98304, per=1.41%, avg=51492.57, stdev=31802.93, samples=7 00:20:33.862 iops : min= 16, max= 96, avg=50.29, stdev=31.06, samples=7 00:20:33.862 lat (msec) : 50=0.33%, 2000=14.47%, >=2000=85.20% 00:20:33.862 cpu : usr=0.00%, sys=1.15%, ctx=588, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.6%, 16=5.3%, 32=10.5%, >=64=79.3% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:20:33.862 issued rwts: total=304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565239: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=51, BW=51.3MiB/s (53.8MB/s)(515MiB/10030msec) 00:20:33.862 slat (usec): min=28, max=2130.7k, avg=19419.10, stdev=134908.29 00:20:33.862 clat (msec): min=25, max=8014, avg=1158.26, stdev=1718.50 00:20:33.862 lat (msec): min=33, max=8019, avg=1177.68, stdev=1744.31 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 48], 5.00th=[ 165], 10.00th=[ 309], 20.00th=[ 426], 00:20:33.862 | 30.00th=[ 472], 40.00th=[ 558], 50.00th=[ 667], 60.00th=[ 743], 00:20:33.862 | 70.00th=[ 810], 80.00th=[ 1116], 90.00th=[ 1871], 95.00th=[ 7819], 00:20:33.862 | 99.00th=[ 8020], 99.50th=[ 8020], 99.90th=[ 8020], 99.95th=[ 8020], 00:20:33.862 | 99.99th=[ 8020] 00:20:33.862 bw ( KiB/s): min=157696, max=307200, per=5.99%, avg=219136.00, stdev=78227.17, samples=3 00:20:33.862 iops : min= 154, max= 300, avg=214.00, stdev=76.39, samples=3 00:20:33.862 lat (msec) : 50=1.36%, 100=1.75%, 250=3.50%, 500=26.21%, 750=29.13% 00:20:33.862 lat (msec) : 1000=16.50%, 2000=12.62%, >=2000=8.93% 00:20:33.862 cpu : usr=0.01%, sys=1.25%, ctx=973, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.8% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.862 issued rwts: total=515,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565240: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=111, BW=112MiB/s (117MB/s)(1128MiB/10076msec) 00:20:33.862 slat (usec): min=25, max=1796.5k, avg=8868.15, stdev=54646.16 00:20:33.862 clat (msec): min=67, max=2786, avg=956.99, stdev=533.74 00:20:33.862 lat (msec): min=84, max=2794, avg=965.86, stdev=537.11 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 201], 5.00th=[ 439], 10.00th=[ 477], 20.00th=[ 542], 00:20:33.862 | 30.00th=[ 634], 40.00th=[ 726], 50.00th=[ 810], 60.00th=[ 944], 00:20:33.862 | 70.00th=[ 1036], 80.00th=[ 1267], 90.00th=[ 1737], 95.00th=[ 1905], 00:20:33.862 | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2802], 99.95th=[ 2802], 00:20:33.862 | 99.99th=[ 2802] 00:20:33.862 bw ( KiB/s): min=34816, max=253952, per=3.73%, avg=136297.93, stdev=68366.87, samples=15 00:20:33.862 iops : min= 34, max= 248, avg=133.07, stdev=66.70, samples=15 00:20:33.862 lat (msec) : 100=0.35%, 250=0.80%, 500=11.97%, 750=30.23%, 1000=22.25% 00:20:33.862 lat (msec) : 2000=30.14%, >=2000=4.26% 00:20:33.862 cpu : usr=0.05%, sys=1.55%, ctx=1730, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.8%, >=64=94.4% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.862 issued rwts: total=1128,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.862 job1: (groupid=0, jobs=1): err= 0: pid=3565241: Fri Apr 26 15:08:14 2024 00:20:33.862 read: IOPS=101, BW=102MiB/s (106MB/s)(1022MiB/10068msec) 00:20:33.862 slat (usec): min=23, max=2114.4k, avg=9780.61, stdev=70284.81 00:20:33.862 clat (msec): min=66, max=3789, avg=1157.80, stdev=1003.34 00:20:33.862 lat (msec): min=68, max=3824, avg=1167.58, stdev=1006.90 00:20:33.862 clat percentiles (msec): 00:20:33.862 | 1.00th=[ 127], 5.00th=[ 330], 10.00th=[ 447], 20.00th=[ 518], 00:20:33.862 | 30.00th=[ 558], 40.00th=[ 651], 50.00th=[ 726], 60.00th=[ 810], 00:20:33.862 | 70.00th=[ 927], 80.00th=[ 1838], 90.00th=[ 3373], 95.00th=[ 3540], 00:20:33.862 | 99.00th=[ 3742], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], 00:20:33.862 | 99.99th=[ 3775] 00:20:33.862 bw ( KiB/s): min= 2052, max=253445, per=3.86%, avg=141011.23, stdev=83673.31, samples=13 00:20:33.862 iops : min= 2, max= 247, avg=137.62, stdev=81.62, samples=13 00:20:33.862 lat (msec) : 100=0.29%, 250=3.52%, 500=11.74%, 750=37.38%, 1000=18.79% 00:20:33.862 lat (msec) : 2000=12.33%, >=2000=15.95% 00:20:33.862 cpu : usr=0.03%, sys=1.91%, ctx=1382, majf=0, minf=32769 00:20:33.862 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.1%, >=64=93.8% 00:20:33.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.862 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.862 issued rwts: total=1022,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job1: (groupid=0, jobs=1): err= 0: pid=3565242: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=55, BW=55.2MiB/s (57.9MB/s)(578MiB/10472msec) 00:20:33.863 slat (usec): min=25, max=2071.9k, avg=18046.26, stdev=126717.15 00:20:33.863 clat (msec): min=37, max=3777, avg=1917.01, stdev=1059.70 00:20:33.863 lat (msec): min=436, max=3796, avg=1935.06, stdev=1060.60 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 498], 5.00th=[ 575], 10.00th=[ 625], 20.00th=[ 667], 00:20:33.863 | 30.00th=[ 776], 40.00th=[ 1636], 50.00th=[ 1938], 60.00th=[ 2433], 00:20:33.863 | 70.00th=[ 2702], 80.00th=[ 2970], 90.00th=[ 3272], 95.00th=[ 3473], 00:20:33.863 | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3775], 99.95th=[ 3775], 00:20:33.863 | 99.99th=[ 3775] 00:20:33.863 bw ( KiB/s): min=20480, max=264192, per=2.52%, avg=92160.00, stdev=72052.87, samples=10 00:20:33.863 iops : min= 20, max= 258, avg=90.00, stdev=70.36, samples=10 00:20:33.863 lat (msec) : 50=0.17%, 500=1.04%, 750=27.16%, 1000=6.06%, 2000=16.44% 00:20:33.863 lat (msec) : >=2000=49.13% 00:20:33.863 cpu : usr=0.02%, sys=0.99%, ctx=618, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.5%, >=64=89.1% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.863 issued rwts: total=578,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job1: (groupid=0, jobs=1): err= 0: pid=3565243: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=45, BW=45.2MiB/s (47.3MB/s)(454MiB/10054msec) 00:20:33.863 slat (usec): min=39, max=4782.2k, avg=22059.80, stdev=224838.28 00:20:33.863 clat (msec): min=35, max=6768, avg=2680.64, stdev=2470.42 00:20:33.863 lat (msec): min=55, max=6784, avg=2702.70, stdev=2477.12 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 65], 5.00th=[ 142], 10.00th=[ 292], 20.00th=[ 827], 00:20:33.863 | 30.00th=[ 1301], 40.00th=[ 1452], 50.00th=[ 1603], 60.00th=[ 1720], 00:20:33.863 | 70.00th=[ 1770], 80.00th=[ 6477], 90.00th=[ 6611], 95.00th=[ 6611], 00:20:33.863 | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6745], 99.95th=[ 6745], 00:20:33.863 | 99.99th=[ 6745] 00:20:33.863 bw ( KiB/s): min= 4087, max=149504, per=1.83%, avg=66763.90, stdev=40031.69, samples=10 00:20:33.863 iops : min= 3, max= 146, avg=65.10, stdev=39.27, samples=10 00:20:33.863 lat (msec) : 50=0.22%, 100=1.98%, 250=6.61%, 500=7.05%, 750=3.30% 00:20:33.863 lat (msec) : 1000=4.85%, 2000=48.02%, >=2000=27.97% 00:20:33.863 cpu : usr=0.03%, sys=1.43%, ctx=809, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.5%, 32=7.0%, >=64=86.1% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.863 issued rwts: total=454,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565251: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=13, BW=13.4MiB/s (14.0MB/s)(143MiB/10682msec) 00:20:33.863 slat (usec): min=236, max=2147.5k, avg=74551.92, stdev=346894.89 00:20:33.863 clat (msec): min=20, max=10451, avg=8686.59, stdev=2379.65 00:20:33.863 lat (msec): min=1871, max=10475, avg=8761.14, stdev=2266.30 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 1871], 5.00th=[ 1921], 10.00th=[ 4279], 20.00th=[ 8792], 00:20:33.863 | 30.00th=[ 9194], 40.00th=[ 9463], 50.00th=[ 9597], 60.00th=[ 9597], 00:20:33.863 | 70.00th=[ 9731], 80.00th=[10000], 90.00th=[10134], 95.00th=[10268], 00:20:33.863 | 99.00th=[10402], 99.50th=[10402], 99.90th=[10402], 99.95th=[10402], 00:20:33.863 | 99.99th=[10402] 00:20:33.863 bw ( KiB/s): min= 2048, max=16384, per=0.17%, avg=6144.00, stdev=5792.62, samples=5 00:20:33.863 iops : min= 2, max= 16, avg= 6.00, stdev= 5.66, samples=5 00:20:33.863 lat (msec) : 50=0.70%, 2000=5.59%, >=2000=93.71% 00:20:33.863 cpu : usr=0.02%, sys=0.84%, ctx=295, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.6%, 16=11.2%, 32=22.4%, >=64=55.9% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=5.9% 00:20:33.863 issued rwts: total=143,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565252: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=80, BW=80.1MiB/s (84.0MB/s)(919MiB/11475msec) 00:20:33.863 slat (usec): min=25, max=1979.0k, avg=12454.01, stdev=67550.18 00:20:33.863 clat (msec): min=23, max=2881, avg=1371.90, stdev=604.15 00:20:33.863 lat (msec): min=688, max=2884, avg=1384.35, stdev=604.95 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 701], 5.00th=[ 785], 10.00th=[ 860], 20.00th=[ 927], 00:20:33.863 | 30.00th=[ 953], 40.00th=[ 1003], 50.00th=[ 1083], 60.00th=[ 1284], 00:20:33.863 | 70.00th=[ 1519], 80.00th=[ 1921], 90.00th=[ 2467], 95.00th=[ 2668], 00:20:33.863 | 99.00th=[ 2836], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], 00:20:33.863 | 99.99th=[ 2869] 00:20:33.863 bw ( KiB/s): min=22528, max=182272, per=3.17%, avg=115755.36, stdev=41442.91, samples=14 00:20:33.863 iops : min= 22, max= 178, avg=112.93, stdev=40.43, samples=14 00:20:33.863 lat (msec) : 50=0.11%, 750=3.37%, 1000=36.34%, 2000=40.81%, >=2000=19.37% 00:20:33.863 cpu : usr=0.07%, sys=1.17%, ctx=1258, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.1% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.863 issued rwts: total=919,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565254: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=21, BW=21.1MiB/s (22.1MB/s)(226MiB/10723msec) 00:20:33.863 slat (usec): min=37, max=2132.1k, avg=47251.30, stdev=267180.20 00:20:33.863 clat (msec): min=43, max=9303, avg=5597.48, stdev=3064.24 00:20:33.863 lat (msec): min=1618, max=9333, avg=5644.74, stdev=3052.04 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 1620], 5.00th=[ 1687], 10.00th=[ 1754], 20.00th=[ 1905], 00:20:33.863 | 30.00th=[ 2123], 40.00th=[ 4279], 50.00th=[ 6007], 60.00th=[ 7483], 00:20:33.863 | 70.00th=[ 8792], 80.00th=[ 8926], 90.00th=[ 9060], 95.00th=[ 9194], 00:20:33.863 | 99.00th=[ 9329], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:20:33.863 | 99.99th=[ 9329] 00:20:33.863 bw ( KiB/s): min= 4096, max=83968, per=0.91%, avg=33439.67, stdev=34844.37, samples=6 00:20:33.863 iops : min= 4, max= 82, avg=32.50, stdev=34.03, samples=6 00:20:33.863 lat (msec) : 50=0.44%, 2000=23.89%, >=2000=75.66% 00:20:33.863 cpu : usr=0.01%, sys=1.05%, ctx=337, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.4%, 2=0.9%, 4=1.8%, 8=3.5%, 16=7.1%, 32=14.2%, >=64=72.1% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.0% 00:20:33.863 issued rwts: total=226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565255: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=32, BW=32.1MiB/s (33.7MB/s)(344MiB/10718msec) 00:20:33.863 slat (usec): min=24, max=2147.6k, avg=31049.51, stdev=193452.24 00:20:33.863 clat (msec): min=35, max=7528, avg=3599.13, stdev=2749.21 00:20:33.863 lat (msec): min=480, max=7528, avg=3630.18, stdev=2744.18 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 523], 5.00th=[ 726], 10.00th=[ 827], 20.00th=[ 986], 00:20:33.863 | 30.00th=[ 1485], 40.00th=[ 1989], 50.00th=[ 2265], 60.00th=[ 2500], 00:20:33.863 | 70.00th=[ 7080], 80.00th=[ 7215], 90.00th=[ 7416], 95.00th=[ 7483], 00:20:33.863 | 99.00th=[ 7550], 99.50th=[ 7550], 99.90th=[ 7550], 99.95th=[ 7550], 00:20:33.863 | 99.99th=[ 7550] 00:20:33.863 bw ( KiB/s): min= 2043, max=208896, per=1.73%, avg=63194.71, stdev=72537.97, samples=7 00:20:33.863 iops : min= 1, max= 204, avg=61.57, stdev=70.98, samples=7 00:20:33.863 lat (msec) : 50=0.29%, 500=0.29%, 750=5.23%, 1000=14.83%, 2000=20.93% 00:20:33.863 lat (msec) : >=2000=58.43% 00:20:33.863 cpu : usr=0.01%, sys=1.11%, ctx=600, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.3%, 16=4.7%, 32=9.3%, >=64=81.7% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.863 issued rwts: total=344,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565256: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=145, BW=145MiB/s (152MB/s)(1558MiB/10723msec) 00:20:33.863 slat (usec): min=23, max=2117.3k, avg=6843.83, stdev=54824.43 00:20:33.863 clat (msec): min=52, max=2705, avg=824.05, stdev=572.54 00:20:33.863 lat (msec): min=200, max=2707, avg=830.90, stdev=573.74 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 228], 5.00th=[ 271], 10.00th=[ 393], 20.00th=[ 527], 00:20:33.863 | 30.00th=[ 542], 40.00th=[ 558], 50.00th=[ 625], 60.00th=[ 676], 00:20:33.863 | 70.00th=[ 718], 80.00th=[ 1116], 90.00th=[ 1636], 95.00th=[ 2366], 00:20:33.863 | 99.00th=[ 2635], 99.50th=[ 2668], 99.90th=[ 2702], 99.95th=[ 2702], 00:20:33.863 | 99.99th=[ 2702] 00:20:33.863 bw ( KiB/s): min=22528, max=313344, per=5.34%, avg=195219.47, stdev=86406.73, samples=15 00:20:33.863 iops : min= 22, max= 306, avg=190.60, stdev=84.39, samples=15 00:20:33.863 lat (msec) : 100=0.06%, 250=2.89%, 500=13.09%, 750=58.92%, 1000=3.66% 00:20:33.863 lat (msec) : 2000=13.22%, >=2000=8.15% 00:20:33.863 cpu : usr=0.09%, sys=1.95%, ctx=1483, majf=0, minf=32769 00:20:33.863 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.1%, >=64=96.0% 00:20:33.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.863 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.863 issued rwts: total=1558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.863 job2: (groupid=0, jobs=1): err= 0: pid=3565257: Fri Apr 26 15:08:14 2024 00:20:33.863 read: IOPS=6, BW=6567KiB/s (6724kB/s)(68.0MiB/10604msec) 00:20:33.863 slat (usec): min=371, max=3948.6k, avg=155240.63, stdev=585301.23 00:20:33.863 clat (msec): min=46, max=10587, avg=8998.75, stdev=1795.95 00:20:33.863 lat (msec): min=2106, max=10603, avg=9153.99, stdev=1429.44 00:20:33.863 clat percentiles (msec): 00:20:33.863 | 1.00th=[ 47], 5.00th=[ 4279], 10.00th=[ 8356], 20.00th=[ 8490], 00:20:33.863 | 30.00th=[ 8792], 40.00th=[ 9060], 50.00th=[ 9329], 60.00th=[ 9463], 00:20:33.864 | 70.00th=[ 9731], 80.00th=[10134], 90.00th=[10537], 95.00th=[10537], 00:20:33.864 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.864 | 99.99th=[10537] 00:20:33.864 lat (msec) : 50=1.47%, >=2000=98.53% 00:20:33.864 cpu : usr=0.01%, sys=0.47%, ctx=336, majf=0, minf=17409 00:20:33.864 IO depths : 1=1.5%, 2=2.9%, 4=5.9%, 8=11.8%, 16=23.5%, 32=47.1%, >=64=7.4% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:20:33.864 issued rwts: total=68,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565258: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=6, BW=7162KiB/s (7333kB/s)(75.0MiB/10724msec) 00:20:33.864 slat (usec): min=258, max=4234.0k, avg=142784.59, stdev=620129.53 00:20:33.864 clat (msec): min=14, max=10720, avg=9776.31, stdev=2155.26 00:20:33.864 lat (msec): min=4248, max=10723, avg=9919.09, stdev=1829.99 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 15], 5.00th=[ 4279], 10.00th=[ 6477], 20.00th=[10402], 00:20:33.864 | 30.00th=[10402], 40.00th=[10537], 50.00th=[10537], 60.00th=[10671], 00:20:33.864 | 70.00th=[10671], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:20:33.864 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:20:33.864 | 99.99th=[10671] 00:20:33.864 lat (msec) : 20=1.33%, >=2000=98.67% 00:20:33.864 cpu : usr=0.00%, sys=0.73%, ctx=117, majf=0, minf=19201 00:20:33.864 IO depths : 1=1.3%, 2=2.7%, 4=5.3%, 8=10.7%, 16=21.3%, 32=42.7%, >=64=16.0% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:20:33.864 issued rwts: total=75,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565259: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=12, BW=12.2MiB/s (12.8MB/s)(131MiB/10719msec) 00:20:33.864 slat (usec): min=225, max=2127.8k, avg=81662.69, stdev=323778.30 00:20:33.864 clat (msec): min=20, max=10703, avg=6298.18, stdev=4058.24 00:20:33.864 lat (msec): min=1114, max=10705, avg=6379.85, stdev=4038.51 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 1116], 5.00th=[ 1217], 10.00th=[ 1234], 20.00th=[ 1469], 00:20:33.864 | 30.00th=[ 1787], 40.00th=[ 4279], 50.00th=[ 9060], 60.00th=[ 9329], 00:20:33.864 | 70.00th=[10000], 80.00th=[10537], 90.00th=[10671], 95.00th=[10671], 00:20:33.864 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:20:33.864 | 99.99th=[10671] 00:20:33.864 bw ( KiB/s): min= 6144, max= 6144, per=0.17%, avg=6144.00, stdev= 0.00, samples=1 00:20:33.864 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 00:20:33.864 lat (msec) : 50=0.76%, 2000=32.82%, >=2000=66.41% 00:20:33.864 cpu : usr=0.00%, sys=0.91%, ctx=379, majf=0, minf=32769 00:20:33.864 IO depths : 1=0.8%, 2=1.5%, 4=3.1%, 8=6.1%, 16=12.2%, 32=24.4%, >=64=51.9% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=80.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=20.0% 00:20:33.864 issued rwts: total=131,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565260: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=3, BW=3844KiB/s (3936kB/s)(40.0MiB/10655msec) 00:20:33.864 slat (usec): min=1797, max=2120.7k, avg=265326.56, stdev=668444.68 00:20:33.864 clat (msec): min=41, max=10652, avg=8564.61, stdev=2967.05 00:20:33.864 lat (msec): min=2112, max=10654, avg=8829.94, stdev=2642.03 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 42], 5.00th=[ 2106], 10.00th=[ 4178], 20.00th=[ 4279], 00:20:33.864 | 30.00th=[ 6409], 40.00th=[10268], 50.00th=[10402], 60.00th=[10402], 00:20:33.864 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10671], 95.00th=[10671], 00:20:33.864 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:20:33.864 | 99.99th=[10671] 00:20:33.864 lat (msec) : 50=2.50%, >=2000=97.50% 00:20:33.864 cpu : usr=0.00%, sys=0.34%, ctx=115, majf=0, minf=10241 00:20:33.864 IO depths : 1=2.5%, 2=5.0%, 4=10.0%, 8=20.0%, 16=40.0%, 32=22.5%, >=64=0.0% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:20:33.864 issued rwts: total=40,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565261: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=39, BW=39.5MiB/s (41.4MB/s)(416MiB/10526msec) 00:20:33.864 slat (usec): min=33, max=2074.6k, avg=25185.35, stdev=144921.49 00:20:33.864 clat (msec): min=46, max=6389, avg=2819.19, stdev=1729.59 00:20:33.864 lat (msec): min=837, max=6420, avg=2844.37, stdev=1727.26 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 835], 5.00th=[ 978], 10.00th=[ 1083], 20.00th=[ 1385], 00:20:33.864 | 30.00th=[ 1687], 40.00th=[ 1821], 50.00th=[ 2333], 60.00th=[ 2567], 00:20:33.864 | 70.00th=[ 3339], 80.00th=[ 4111], 90.00th=[ 6208], 95.00th=[ 6275], 00:20:33.864 | 99.00th=[ 6342], 99.50th=[ 6342], 99.90th=[ 6409], 99.95th=[ 6409], 00:20:33.864 | 99.99th=[ 6409] 00:20:33.864 bw ( KiB/s): min= 2048, max=180224, per=1.79%, avg=65536.00, stdev=55163.10, samples=9 00:20:33.864 iops : min= 2, max= 176, avg=64.00, stdev=53.87, samples=9 00:20:33.864 lat (msec) : 50=0.24%, 1000=6.01%, 2000=39.18%, >=2000=54.57% 00:20:33.864 cpu : usr=0.01%, sys=0.84%, ctx=771, majf=0, minf=32769 00:20:33.864 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.7%, >=64=84.9% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.864 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565262: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=34, BW=34.5MiB/s (36.2MB/s)(365MiB/10565msec) 00:20:33.864 slat (usec): min=27, max=2148.0k, avg=28899.49, stdev=193820.62 00:20:33.864 clat (msec): min=14, max=7417, avg=3300.38, stdev=2820.12 00:20:33.864 lat (msec): min=548, max=7417, avg=3329.28, stdev=2817.06 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 550], 5.00th=[ 617], 10.00th=[ 693], 20.00th=[ 793], 00:20:33.864 | 30.00th=[ 1284], 40.00th=[ 1452], 50.00th=[ 1754], 60.00th=[ 1888], 00:20:33.864 | 70.00th=[ 6946], 80.00th=[ 7080], 90.00th=[ 7282], 95.00th=[ 7349], 00:20:33.864 | 99.00th=[ 7416], 99.50th=[ 7416], 99.90th=[ 7416], 99.95th=[ 7416], 00:20:33.864 | 99.99th=[ 7416] 00:20:33.864 bw ( KiB/s): min= 2048, max=221184, per=1.66%, avg=60672.00, stdev=77553.58, samples=8 00:20:33.864 iops : min= 2, max= 216, avg=59.25, stdev=75.74, samples=8 00:20:33.864 lat (msec) : 20=0.27%, 500=0.27%, 750=17.26%, 1000=4.66%, 2000=41.92% 00:20:33.864 lat (msec) : >=2000=35.62% 00:20:33.864 cpu : usr=0.02%, sys=0.80%, ctx=538, majf=0, minf=32769 00:20:33.864 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.2%, 16=4.4%, 32=8.8%, >=64=82.7% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:20:33.864 issued rwts: total=365,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565263: Fri Apr 26 15:08:14 2024 00:20:33.864 read: IOPS=10, BW=10.5MiB/s (11.0MB/s)(111MiB/10544msec) 00:20:33.864 slat (usec): min=553, max=4211.4k, avg=94590.80, stdev=472585.88 00:20:33.864 clat (msec): min=43, max=10527, avg=9040.62, stdev=1220.28 00:20:33.864 lat (msec): min=4255, max=10543, avg=9135.21, stdev=874.50 00:20:33.864 clat percentiles (msec): 00:20:33.864 | 1.00th=[ 4245], 5.00th=[ 8154], 10.00th=[ 8221], 20.00th=[ 8356], 00:20:33.864 | 30.00th=[ 8658], 40.00th=[ 9060], 50.00th=[ 9194], 60.00th=[ 9463], 00:20:33.864 | 70.00th=[ 9597], 80.00th=[ 9866], 90.00th=[10134], 95.00th=[10268], 00:20:33.864 | 99.00th=[10402], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.864 | 99.99th=[10537] 00:20:33.864 lat (msec) : 50=0.90%, >=2000=99.10% 00:20:33.864 cpu : usr=0.01%, sys=0.63%, ctx=347, majf=0, minf=28417 00:20:33.864 IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.2%, 16=14.4%, 32=28.8%, >=64=43.2% 00:20:33.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.864 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:20:33.864 issued rwts: total=111,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.864 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.864 job2: (groupid=0, jobs=1): err= 0: pid=3565264: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=99, BW=99.0MiB/s (104MB/s)(998MiB/10079msec) 00:20:33.865 slat (usec): min=23, max=2087.0k, avg=10051.09, stdev=92053.37 00:20:33.865 clat (msec): min=43, max=5141, avg=1221.15, stdev=1366.47 00:20:33.865 lat (msec): min=94, max=5143, avg=1231.20, stdev=1371.68 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 95], 5.00th=[ 209], 10.00th=[ 309], 20.00th=[ 376], 00:20:33.865 | 30.00th=[ 472], 40.00th=[ 558], 50.00th=[ 718], 60.00th=[ 869], 00:20:33.865 | 70.00th=[ 1183], 80.00th=[ 1301], 90.00th=[ 4665], 95.00th=[ 4799], 00:20:33.865 | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], 00:20:33.865 | 99.99th=[ 5134] 00:20:33.865 bw ( KiB/s): min=10240, max=368640, per=4.06%, avg=148474.83, stdev=99894.02, samples=12 00:20:33.865 iops : min= 10, max= 360, avg=144.92, stdev=97.65, samples=12 00:20:33.865 lat (msec) : 50=0.10%, 100=1.70%, 250=3.31%, 500=28.46%, 750=18.34% 00:20:33.865 lat (msec) : 1000=13.43%, 2000=19.94%, >=2000=14.73% 00:20:33.865 cpu : usr=0.03%, sys=1.69%, ctx=921, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.7% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.865 issued rwts: total=998,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565269: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=94, BW=94.8MiB/s (99.4MB/s)(1003MiB/10584msec) 00:20:33.865 slat (usec): min=23, max=2093.9k, avg=10514.39, stdev=94824.31 00:20:33.865 clat (msec): min=34, max=3693, avg=1235.17, stdev=999.36 00:20:33.865 lat (msec): min=158, max=3765, avg=1245.69, stdev=1002.84 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 174], 5.00th=[ 186], 10.00th=[ 205], 20.00th=[ 228], 00:20:33.865 | 30.00th=[ 253], 40.00th=[ 693], 50.00th=[ 919], 60.00th=[ 1519], 00:20:33.865 | 70.00th=[ 1737], 80.00th=[ 2232], 90.00th=[ 2802], 95.00th=[ 2937], 00:20:33.865 | 99.00th=[ 3608], 99.50th=[ 3641], 99.90th=[ 3708], 99.95th=[ 3708], 00:20:33.865 | 99.99th=[ 3708] 00:20:33.865 bw ( KiB/s): min=16384, max=489472, per=4.46%, avg=162909.09, stdev=150831.73, samples=11 00:20:33.865 iops : min= 16, max= 478, avg=159.09, stdev=147.30, samples=11 00:20:33.865 lat (msec) : 50=0.10%, 250=29.01%, 500=4.49%, 750=8.87%, 1000=9.77% 00:20:33.865 lat (msec) : 2000=22.43%, >=2000=25.32% 00:20:33.865 cpu : usr=0.04%, sys=1.14%, ctx=1084, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.7% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.865 issued rwts: total=1003,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565270: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=30, BW=30.6MiB/s (32.1MB/s)(328MiB/10710msec) 00:20:33.865 slat (usec): min=36, max=2093.9k, avg=32478.00, stdev=207470.07 00:20:33.865 clat (msec): min=55, max=8473, avg=3965.32, stdev=3161.05 00:20:33.865 lat (msec): min=935, max=8474, avg=3997.80, stdev=3157.89 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 986], 5.00th=[ 1036], 10.00th=[ 1133], 20.00th=[ 1200], 00:20:33.865 | 30.00th=[ 1519], 40.00th=[ 1703], 50.00th=[ 1754], 60.00th=[ 1871], 00:20:33.865 | 70.00th=[ 7684], 80.00th=[ 7819], 90.00th=[ 8288], 95.00th=[ 8356], 00:20:33.865 | 99.00th=[ 8423], 99.50th=[ 8490], 99.90th=[ 8490], 99.95th=[ 8490], 00:20:33.865 | 99.99th=[ 8490] 00:20:33.865 bw ( KiB/s): min= 2048, max=131072, per=1.60%, avg=58514.29, stdev=59130.80, samples=7 00:20:33.865 iops : min= 2, max= 128, avg=57.14, stdev=57.74, samples=7 00:20:33.865 lat (msec) : 100=0.30%, 1000=1.52%, 2000=58.23%, >=2000=39.94% 00:20:33.865 cpu : usr=0.01%, sys=1.20%, ctx=500, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.9%, 32=9.8%, >=64=80.8% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.865 issued rwts: total=328,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565271: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=71, BW=71.9MiB/s (75.4MB/s)(754MiB/10488msec) 00:20:33.865 slat (usec): min=23, max=2121.6k, avg=13840.63, stdev=111821.63 00:20:33.865 clat (msec): min=48, max=7036, avg=1658.76, stdev=2026.12 00:20:33.865 lat (msec): min=334, max=7085, avg=1672.60, stdev=2033.26 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 338], 5.00th=[ 426], 10.00th=[ 464], 20.00th=[ 567], 00:20:33.865 | 30.00th=[ 634], 40.00th=[ 693], 50.00th=[ 735], 60.00th=[ 760], 00:20:33.865 | 70.00th=[ 860], 80.00th=[ 1854], 90.00th=[ 5873], 95.00th=[ 6544], 00:20:33.865 | 99.00th=[ 7013], 99.50th=[ 7013], 99.90th=[ 7013], 99.95th=[ 7013], 00:20:33.865 | 99.99th=[ 7013] 00:20:33.865 bw ( KiB/s): min= 2048, max=251904, per=2.92%, avg=106837.33, stdev=93112.19, samples=12 00:20:33.865 iops : min= 2, max= 246, avg=104.33, stdev=90.93, samples=12 00:20:33.865 lat (msec) : 50=0.13%, 500=11.54%, 750=42.31%, 1000=18.83%, 2000=8.62% 00:20:33.865 lat (msec) : >=2000=18.57% 00:20:33.865 cpu : usr=0.01%, sys=1.00%, ctx=737, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.6% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.865 issued rwts: total=754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565272: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=2, BW=2742KiB/s (2808kB/s)(28.0MiB/10457msec) 00:20:33.865 slat (msec): min=2, max=2122, avg=370.92, stdev=781.03 00:20:33.865 clat (msec): min=70, max=10374, avg=6418.07, stdev=2950.18 00:20:33.865 lat (msec): min=2090, max=10456, avg=6788.99, stdev=2769.90 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 70], 5.00th=[ 2089], 10.00th=[ 2106], 20.00th=[ 4245], 00:20:33.865 | 30.00th=[ 4279], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 6477], 00:20:33.865 | 70.00th=[ 8557], 80.00th=[10268], 90.00th=[10402], 95.00th=[10402], 00:20:33.865 | 99.00th=[10402], 99.50th=[10402], 99.90th=[10402], 99.95th=[10402], 00:20:33.865 | 99.99th=[10402] 00:20:33.865 lat (msec) : 100=3.57%, >=2000=96.43% 00:20:33.865 cpu : usr=0.01%, sys=0.16%, ctx=67, majf=0, minf=7169 00:20:33.865 IO depths : 1=3.6%, 2=7.1%, 4=14.3%, 8=28.6%, 16=46.4%, 32=0.0%, >=64=0.0% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:20:33.865 issued rwts: total=28,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565273: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=4, BW=4875KiB/s (4992kB/s)(50.0MiB/10503msec) 00:20:33.865 slat (usec): min=616, max=2087.6k, avg=208657.26, stdev=582532.37 00:20:33.865 clat (msec): min=69, max=10501, avg=7176.74, stdev=3145.84 00:20:33.865 lat (msec): min=2095, max=10502, avg=7385.40, stdev=3007.77 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 70], 5.00th=[ 2106], 10.00th=[ 3809], 20.00th=[ 4044], 00:20:33.865 | 30.00th=[ 4279], 40.00th=[ 6409], 50.00th=[ 6477], 60.00th=[ 8557], 00:20:33.865 | 70.00th=[10402], 80.00th=[10537], 90.00th=[10537], 95.00th=[10537], 00:20:33.865 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:20:33.865 | 99.99th=[10537] 00:20:33.865 lat (msec) : 100=2.00%, >=2000=98.00% 00:20:33.865 cpu : usr=0.01%, sys=0.30%, ctx=119, majf=0, minf=12801 00:20:33.865 IO depths : 1=2.0%, 2=4.0%, 4=8.0%, 8=16.0%, 16=32.0%, 32=38.0%, >=64=0.0% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:20:33.865 issued rwts: total=50,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565274: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=22, BW=22.7MiB/s (23.8MB/s)(237MiB/10444msec) 00:20:33.865 slat (usec): min=32, max=2088.0k, avg=43917.29, stdev=229512.23 00:20:33.865 clat (msec): min=34, max=8422, avg=4852.75, stdev=1641.15 00:20:33.865 lat (msec): min=1013, max=8443, avg=4896.67, stdev=1634.80 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 1020], 5.00th=[ 2970], 10.00th=[ 3071], 20.00th=[ 3104], 00:20:33.865 | 30.00th=[ 3406], 40.00th=[ 3876], 50.00th=[ 4329], 60.00th=[ 6007], 00:20:33.865 | 70.00th=[ 6342], 80.00th=[ 6477], 90.00th=[ 6611], 95.00th=[ 6611], 00:20:33.865 | 99.00th=[ 8423], 99.50th=[ 8423], 99.90th=[ 8423], 99.95th=[ 8423], 00:20:33.865 | 99.99th=[ 8423] 00:20:33.865 bw ( KiB/s): min= 4096, max=141312, per=1.22%, avg=44646.40, stdev=56094.27, samples=5 00:20:33.865 iops : min= 4, max= 138, avg=43.60, stdev=54.78, samples=5 00:20:33.865 lat (msec) : 50=0.42%, 2000=1.69%, >=2000=97.89% 00:20:33.865 cpu : usr=0.00%, sys=0.84%, ctx=476, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.4%, 2=0.8%, 4=1.7%, 8=3.4%, 16=6.8%, 32=13.5%, >=64=73.4% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.865 complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.9% 00:20:33.865 issued rwts: total=237,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.865 job3: (groupid=0, jobs=1): err= 0: pid=3565275: Fri Apr 26 15:08:14 2024 00:20:33.865 read: IOPS=78, BW=78.4MiB/s (82.2MB/s)(823MiB/10504msec) 00:20:33.865 slat (usec): min=25, max=2092.1k, avg=12695.95, stdev=108695.27 00:20:33.865 clat (msec): min=52, max=5357, avg=1528.01, stdev=1609.76 00:20:33.865 lat (msec): min=332, max=5362, avg=1540.70, stdev=1614.49 00:20:33.865 clat percentiles (msec): 00:20:33.865 | 1.00th=[ 347], 5.00th=[ 372], 10.00th=[ 397], 20.00th=[ 456], 00:20:33.865 | 30.00th=[ 510], 40.00th=[ 600], 50.00th=[ 986], 60.00th=[ 1062], 00:20:33.865 | 70.00th=[ 1301], 80.00th=[ 1854], 90.00th=[ 5134], 95.00th=[ 5201], 00:20:33.865 | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], 00:20:33.865 | 99.99th=[ 5336] 00:20:33.865 bw ( KiB/s): min= 4096, max=323584, per=3.54%, avg=129396.36, stdev=99579.22, samples=11 00:20:33.865 iops : min= 4, max= 316, avg=126.36, stdev=97.25, samples=11 00:20:33.865 lat (msec) : 100=0.12%, 500=27.58%, 750=15.92%, 1000=8.75%, 2000=29.16% 00:20:33.865 lat (msec) : >=2000=18.47% 00:20:33.865 cpu : usr=0.02%, sys=0.92%, ctx=1181, majf=0, minf=32769 00:20:33.865 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.3% 00:20:33.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.866 issued rwts: total=823,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565276: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=29, BW=29.5MiB/s (30.9MB/s)(315MiB/10676msec) 00:20:33.866 slat (usec): min=42, max=2468.8k, avg=33881.93, stdev=213628.56 00:20:33.866 clat (usec): min=975, max=9303.0k, avg=4175391.82, stdev=3071286.64 00:20:33.866 lat (msec): min=805, max=9308, avg=4209.27, stdev=3075.03 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 818], 5.00th=[ 877], 10.00th=[ 978], 20.00th=[ 1083], 00:20:33.866 | 30.00th=[ 1284], 40.00th=[ 1653], 50.00th=[ 3876], 60.00th=[ 5604], 00:20:33.866 | 70.00th=[ 5805], 80.00th=[ 8356], 90.00th=[ 8792], 95.00th=[ 9060], 00:20:33.866 | 99.00th=[ 9194], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:20:33.866 | 99.99th=[ 9329] 00:20:33.866 bw ( KiB/s): min= 6144, max=94208, per=1.16%, avg=42549.22, stdev=28210.85, samples=9 00:20:33.866 iops : min= 6, max= 92, avg=41.44, stdev=27.66, samples=9 00:20:33.866 lat (usec) : 1000=0.32% 00:20:33.866 lat (msec) : 1000=13.33%, 2000=29.84%, >=2000=56.51% 00:20:33.866 cpu : usr=0.00%, sys=1.26%, ctx=875, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.5%, 16=5.1%, 32=10.2%, >=64=80.0% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.866 issued rwts: total=315,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565277: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=8, BW=8545KiB/s (8750kB/s)(89.0MiB/10666msec) 00:20:33.866 slat (usec): min=349, max=2096.1k, avg=119392.93, stdev=456632.60 00:20:33.866 clat (msec): min=38, max=10664, avg=8849.44, stdev=2719.63 00:20:33.866 lat (msec): min=2106, max=10665, avg=8968.83, stdev=2556.82 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 40], 5.00th=[ 2140], 10.00th=[ 4212], 20.00th=[ 6409], 00:20:33.866 | 30.00th=[ 8557], 40.00th=[10268], 50.00th=[10268], 60.00th=[10402], 00:20:33.866 | 70.00th=[10537], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:20:33.866 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:20:33.866 | 99.99th=[10671] 00:20:33.866 lat (msec) : 50=1.12%, >=2000=98.88% 00:20:33.866 cpu : usr=0.01%, sys=0.67%, ctx=182, majf=0, minf=22785 00:20:33.866 IO depths : 1=1.1%, 2=2.2%, 4=4.5%, 8=9.0%, 16=18.0%, 32=36.0%, >=64=29.2% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:20:33.866 issued rwts: total=89,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565278: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=22, BW=22.9MiB/s (24.0MB/s)(244MiB/10675msec) 00:20:33.866 slat (usec): min=24, max=2122.8k, avg=43521.92, stdev=259776.25 00:20:33.866 clat (msec): min=54, max=9780, avg=5331.24, stdev=3702.00 00:20:33.866 lat (msec): min=1004, max=9811, avg=5374.76, stdev=3694.19 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 1003], 5.00th=[ 1053], 10.00th=[ 1083], 20.00th=[ 1116], 00:20:33.866 | 30.00th=[ 1318], 40.00th=[ 3473], 50.00th=[ 6342], 60.00th=[ 8557], 00:20:33.866 | 70.00th=[ 9060], 80.00th=[ 9329], 90.00th=[ 9597], 95.00th=[ 9597], 00:20:33.866 | 99.00th=[ 9731], 99.50th=[ 9731], 99.90th=[ 9731], 99.95th=[ 9731], 00:20:33.866 | 99.99th=[ 9731] 00:20:33.866 bw ( KiB/s): min= 1646, max=116736, per=0.93%, avg=34173.43, stdev=40579.62, samples=7 00:20:33.866 iops : min= 1, max= 114, avg=33.29, stdev=39.71, samples=7 00:20:33.866 lat (msec) : 100=0.41%, 1000=0.41%, 2000=36.89%, >=2000=62.30% 00:20:33.866 cpu : usr=0.03%, sys=1.00%, ctx=725, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.3%, 16=6.6%, 32=13.1%, >=64=74.2% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:20:33.866 issued rwts: total=244,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565280: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=26, BW=26.8MiB/s (28.1MB/s)(286MiB/10670msec) 00:20:33.866 slat (usec): min=43, max=2117.4k, avg=37057.45, stdev=204595.95 00:20:33.866 clat (msec): min=69, max=5851, avg=3518.55, stdev=1555.26 00:20:33.866 lat (msec): min=1279, max=5889, avg=3555.60, stdev=1538.55 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 1284], 5.00th=[ 1401], 10.00th=[ 1687], 20.00th=[ 2106], 00:20:33.866 | 30.00th=[ 2299], 40.00th=[ 2400], 50.00th=[ 2467], 60.00th=[ 4799], 00:20:33.866 | 70.00th=[ 5000], 80.00th=[ 5201], 90.00th=[ 5470], 95.00th=[ 5604], 00:20:33.866 | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5873], 99.95th=[ 5873], 00:20:33.866 | 99.99th=[ 5873] 00:20:33.866 bw ( KiB/s): min= 1646, max=114688, per=1.27%, avg=46461.43, stdev=47266.86, samples=7 00:20:33.866 iops : min= 1, max= 112, avg=45.29, stdev=46.26, samples=7 00:20:33.866 lat (msec) : 100=0.35%, 2000=16.08%, >=2000=83.57% 00:20:33.866 cpu : usr=0.00%, sys=0.97%, ctx=596, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.3%, 2=0.7%, 4=1.4%, 8=2.8%, 16=5.6%, 32=11.2%, >=64=78.0% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:20:33.866 issued rwts: total=286,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565281: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=21, BW=21.8MiB/s (22.9MB/s)(231MiB/10589msec) 00:20:33.866 slat (usec): min=43, max=2145.3k, avg=45595.15, stdev=230455.26 00:20:33.866 clat (msec): min=54, max=6849, avg=4208.24, stdev=1562.96 00:20:33.866 lat (msec): min=2095, max=6857, avg=4253.83, stdev=1537.67 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 2106], 5.00th=[ 2265], 10.00th=[ 2333], 20.00th=[ 2467], 00:20:33.866 | 30.00th=[ 2668], 40.00th=[ 2769], 50.00th=[ 4933], 60.00th=[ 5134], 00:20:33.866 | 70.00th=[ 5336], 80.00th=[ 5604], 90.00th=[ 6074], 95.00th=[ 6544], 00:20:33.866 | 99.00th=[ 6745], 99.50th=[ 6812], 99.90th=[ 6879], 99.95th=[ 6879], 00:20:33.866 | 99.99th=[ 6879] 00:20:33.866 bw ( KiB/s): min= 1882, max=106496, per=0.97%, avg=35471.00, stdev=39922.73, samples=6 00:20:33.866 iops : min= 1, max= 104, avg=34.50, stdev=39.13, samples=6 00:20:33.866 lat (msec) : 100=0.43%, >=2000=99.57% 00:20:33.866 cpu : usr=0.00%, sys=0.89%, ctx=551, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.5%, 16=6.9%, 32=13.9%, >=64=72.7% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.0% 00:20:33.866 issued rwts: total=231,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job3: (groupid=0, jobs=1): err= 0: pid=3565282: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=44, BW=44.7MiB/s (46.9MB/s)(469MiB/10492msec) 00:20:33.866 slat (usec): min=28, max=2079.5k, avg=22283.24, stdev=185974.31 00:20:33.866 clat (msec): min=39, max=8985, avg=2744.42, stdev=3270.46 00:20:33.866 lat (msec): min=302, max=8985, avg=2766.70, stdev=3279.07 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 313], 5.00th=[ 355], 10.00th=[ 372], 20.00th=[ 430], 00:20:33.866 | 30.00th=[ 575], 40.00th=[ 651], 50.00th=[ 676], 60.00th=[ 693], 00:20:33.866 | 70.00th=[ 4212], 80.00th=[ 6946], 90.00th=[ 8792], 95.00th=[ 8926], 00:20:33.866 | 99.00th=[ 8926], 99.50th=[ 8926], 99.90th=[ 8926], 99.95th=[ 8926], 00:20:33.866 | 99.99th=[ 8926] 00:20:33.866 bw ( KiB/s): min= 2048, max=258048, per=2.73%, avg=99766.86, stdev=100988.86, samples=7 00:20:33.866 iops : min= 2, max= 252, avg=97.43, stdev=98.62, samples=7 00:20:33.866 lat (msec) : 50=0.21%, 500=24.31%, 750=39.23%, >=2000=36.25% 00:20:33.866 cpu : usr=0.03%, sys=0.92%, ctx=632, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.6% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.866 issued rwts: total=469,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job4: (groupid=0, jobs=1): err= 0: pid=3565307: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=31, BW=31.7MiB/s (33.3MB/s)(319MiB/10049msec) 00:20:33.866 slat (usec): min=39, max=2076.5k, avg=31389.52, stdev=181721.80 00:20:33.866 clat (msec): min=33, max=5276, avg=2452.03, stdev=1672.05 00:20:33.866 lat (msec): min=56, max=5288, avg=2483.42, stdev=1678.59 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 58], 5.00th=[ 136], 10.00th=[ 279], 20.00th=[ 751], 00:20:33.866 | 30.00th=[ 1284], 40.00th=[ 1401], 50.00th=[ 1536], 60.00th=[ 3708], 00:20:33.866 | 70.00th=[ 3943], 80.00th=[ 4077], 90.00th=[ 4144], 95.00th=[ 5067], 00:20:33.866 | 99.00th=[ 5201], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:20:33.866 | 99.99th=[ 5269] 00:20:33.866 bw ( KiB/s): min=12288, max=110965, per=1.51%, avg=55349.29, stdev=37539.19, samples=7 00:20:33.866 iops : min= 12, max= 108, avg=54.00, stdev=36.57, samples=7 00:20:33.866 lat (msec) : 50=0.31%, 100=2.82%, 250=5.02%, 500=8.46%, 750=3.45% 00:20:33.866 lat (msec) : 1000=3.76%, 2000=28.21%, >=2000=47.96% 00:20:33.866 cpu : usr=0.03%, sys=0.78%, ctx=782, majf=0, minf=32769 00:20:33.866 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.5%, 16=5.0%, 32=10.0%, >=64=80.3% 00:20:33.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.866 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.866 issued rwts: total=319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.866 job4: (groupid=0, jobs=1): err= 0: pid=3565309: Fri Apr 26 15:08:14 2024 00:20:33.866 read: IOPS=34, BW=34.3MiB/s (36.0MB/s)(358MiB/10423msec) 00:20:33.866 slat (usec): min=34, max=2124.4k, avg=28989.94, stdev=205104.39 00:20:33.866 clat (msec): min=42, max=5271, avg=2071.00, stdev=1682.82 00:20:33.866 lat (msec): min=349, max=5323, avg=2099.99, stdev=1689.25 00:20:33.866 clat percentiles (msec): 00:20:33.866 | 1.00th=[ 351], 5.00th=[ 363], 10.00th=[ 422], 20.00th=[ 558], 00:20:33.866 | 30.00th=[ 785], 40.00th=[ 961], 50.00th=[ 1150], 60.00th=[ 1385], 00:20:33.866 | 70.00th=[ 4144], 80.00th=[ 4396], 90.00th=[ 4463], 95.00th=[ 4530], 00:20:33.866 | 99.00th=[ 4530], 99.50th=[ 4597], 99.90th=[ 5269], 99.95th=[ 5269], 00:20:33.866 | 99.99th=[ 5269] 00:20:33.867 bw ( KiB/s): min=26624, max=262144, per=3.22%, avg=117760.00, stdev=104220.20, samples=4 00:20:33.867 iops : min= 26, max= 256, avg=115.00, stdev=101.78, samples=4 00:20:33.867 lat (msec) : 50=0.28%, 500=14.80%, 750=12.01%, 1000=14.80%, 2000=18.16% 00:20:33.867 lat (msec) : >=2000=39.94% 00:20:33.867 cpu : usr=0.02%, sys=0.74%, ctx=848, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.2%, 16=4.5%, 32=8.9%, >=64=82.4% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:20:33.867 issued rwts: total=358,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565310: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=44, BW=44.2MiB/s (46.3MB/s)(447MiB/10114msec) 00:20:33.867 slat (usec): min=28, max=2077.9k, avg=22474.98, stdev=166913.66 00:20:33.867 clat (msec): min=64, max=7143, avg=2647.63, stdev=2469.80 00:20:33.867 lat (msec): min=115, max=7143, avg=2670.11, stdev=2475.63 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 129], 5.00th=[ 334], 10.00th=[ 506], 20.00th=[ 735], 00:20:33.867 | 30.00th=[ 911], 40.00th=[ 1099], 50.00th=[ 1418], 60.00th=[ 1519], 00:20:33.867 | 70.00th=[ 3373], 80.00th=[ 6678], 90.00th=[ 6812], 95.00th=[ 7013], 00:20:33.867 | 99.00th=[ 7148], 99.50th=[ 7148], 99.90th=[ 7148], 99.95th=[ 7148], 00:20:33.867 | 99.99th=[ 7148] 00:20:33.867 bw ( KiB/s): min=28672, max=247313, per=2.23%, avg=81602.12, stdev=72414.81, samples=8 00:20:33.867 iops : min= 28, max= 241, avg=79.62, stdev=70.55, samples=8 00:20:33.867 lat (msec) : 100=0.22%, 250=2.01%, 500=6.04%, 750=12.08%, 1000=14.09% 00:20:33.867 lat (msec) : 2000=29.53%, >=2000=36.02% 00:20:33.867 cpu : usr=0.02%, sys=1.36%, ctx=523, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.9% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.867 issued rwts: total=447,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565311: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=93, BW=93.1MiB/s (97.6MB/s)(935MiB/10044msec) 00:20:33.867 slat (usec): min=24, max=850924, avg=10695.68, stdev=35198.77 00:20:33.867 clat (msec): min=38, max=2634, avg=1172.36, stdev=620.72 00:20:33.867 lat (msec): min=73, max=2644, avg=1183.06, stdev=624.56 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 81], 5.00th=[ 443], 10.00th=[ 617], 20.00th=[ 659], 00:20:33.867 | 30.00th=[ 709], 40.00th=[ 776], 50.00th=[ 986], 60.00th=[ 1234], 00:20:33.867 | 70.00th=[ 1435], 80.00th=[ 1838], 90.00th=[ 2165], 95.00th=[ 2299], 00:20:33.867 | 99.00th=[ 2567], 99.50th=[ 2601], 99.90th=[ 2635], 99.95th=[ 2635], 00:20:33.867 | 99.99th=[ 2635] 00:20:33.867 bw ( KiB/s): min=43008, max=223232, per=3.01%, avg=109911.47, stdev=59688.75, samples=15 00:20:33.867 iops : min= 42, max= 218, avg=107.27, stdev=58.26, samples=15 00:20:33.867 lat (msec) : 50=0.11%, 100=1.71%, 250=1.82%, 500=1.71%, 750=31.87% 00:20:33.867 lat (msec) : 1000=13.58%, 2000=33.26%, >=2000=15.94% 00:20:33.867 cpu : usr=0.03%, sys=1.37%, ctx=1376, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.4%, >=64=93.3% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.867 issued rwts: total=935,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565312: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=74, BW=74.7MiB/s (78.4MB/s)(753MiB/10077msec) 00:20:33.867 slat (usec): min=27, max=2038.2k, avg=13323.65, stdev=76635.63 00:20:33.867 clat (msec): min=39, max=3876, avg=1568.45, stdev=995.24 00:20:33.867 lat (msec): min=86, max=3894, avg=1581.77, stdev=998.78 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 144], 5.00th=[ 355], 10.00th=[ 810], 20.00th=[ 835], 00:20:33.867 | 30.00th=[ 902], 40.00th=[ 1183], 50.00th=[ 1334], 60.00th=[ 1536], 00:20:33.867 | 70.00th=[ 1603], 80.00th=[ 1670], 90.00th=[ 3574], 95.00th=[ 3708], 00:20:33.867 | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3876], 99.95th=[ 3876], 00:20:33.867 | 99.99th=[ 3876] 00:20:33.867 bw ( KiB/s): min=20480, max=163840, per=2.50%, avg=91419.79, stdev=44264.86, samples=14 00:20:33.867 iops : min= 20, max= 160, avg=89.21, stdev=43.27, samples=14 00:20:33.867 lat (msec) : 50=0.13%, 100=0.53%, 250=2.92%, 500=2.52%, 750=1.20% 00:20:33.867 lat (msec) : 1000=27.36%, 2000=48.47%, >=2000=16.87% 00:20:33.867 cpu : usr=0.04%, sys=1.61%, ctx=1290, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.6% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.867 issued rwts: total=753,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565313: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=30, BW=30.1MiB/s (31.6MB/s)(303MiB/10056msec) 00:20:33.867 slat (usec): min=53, max=2060.9k, avg=33006.36, stdev=190447.28 00:20:33.867 clat (msec): min=53, max=5758, avg=3240.63, stdev=1665.98 00:20:33.867 lat (msec): min=102, max=5808, avg=3273.64, stdev=1662.94 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 107], 5.00th=[ 300], 10.00th=[ 693], 20.00th=[ 1385], 00:20:33.867 | 30.00th=[ 1905], 40.00th=[ 3574], 50.00th=[ 3708], 60.00th=[ 3876], 00:20:33.867 | 70.00th=[ 4178], 80.00th=[ 4329], 90.00th=[ 5403], 95.00th=[ 5537], 00:20:33.867 | 99.00th=[ 5738], 99.50th=[ 5738], 99.90th=[ 5738], 99.95th=[ 5738], 00:20:33.867 | 99.99th=[ 5738] 00:20:33.867 bw ( KiB/s): min=30720, max=67449, per=1.41%, avg=51492.00, stdev=14594.71, samples=7 00:20:33.867 iops : min= 30, max= 65, avg=50.14, stdev=14.08, samples=7 00:20:33.867 lat (msec) : 100=0.33%, 250=3.96%, 500=3.96%, 750=1.98%, 1000=2.31% 00:20:33.867 lat (msec) : 2000=22.11%, >=2000=65.35% 00:20:33.867 cpu : usr=0.02%, sys=1.36%, ctx=722, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.6%, 16=5.3%, 32=10.6%, >=64=79.2% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:20:33.867 issued rwts: total=303,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565314: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=29, BW=29.0MiB/s (30.4MB/s)(308MiB/10619msec) 00:20:33.867 slat (usec): min=41, max=2054.7k, avg=34329.91, stdev=219488.29 00:20:33.867 clat (msec): min=43, max=5332, avg=3156.36, stdev=1741.07 00:20:33.867 lat (msec): min=1018, max=5334, avg=3190.69, stdev=1731.94 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 1020], 5.00th=[ 1099], 10.00th=[ 1133], 20.00th=[ 1167], 00:20:33.867 | 30.00th=[ 1217], 40.00th=[ 1334], 50.00th=[ 4144], 60.00th=[ 4396], 00:20:33.867 | 70.00th=[ 4732], 80.00th=[ 4933], 90.00th=[ 5000], 95.00th=[ 5134], 00:20:33.867 | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5336], 99.95th=[ 5336], 00:20:33.867 | 99.99th=[ 5336] 00:20:33.867 bw ( KiB/s): min= 2048, max=118784, per=1.44%, avg=52662.86, stdev=52530.49, samples=7 00:20:33.867 iops : min= 2, max= 116, avg=51.43, stdev=51.30, samples=7 00:20:33.867 lat (msec) : 50=0.32%, 2000=40.58%, >=2000=59.09% 00:20:33.867 cpu : usr=0.00%, sys=1.04%, ctx=828, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.6%, 16=5.2%, 32=10.4%, >=64=79.5% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.867 issued rwts: total=308,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565315: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=81, BW=81.1MiB/s (85.1MB/s)(816MiB/10058msec) 00:20:33.867 slat (usec): min=22, max=1238.9k, avg=12252.55, stdev=53636.81 00:20:33.867 clat (msec): min=55, max=3383, avg=1388.05, stdev=799.43 00:20:33.867 lat (msec): min=60, max=3428, avg=1400.31, stdev=804.84 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 123], 5.00th=[ 271], 10.00th=[ 397], 20.00th=[ 527], 00:20:33.867 | 30.00th=[ 802], 40.00th=[ 1083], 50.00th=[ 1418], 60.00th=[ 1653], 00:20:33.867 | 70.00th=[ 1720], 80.00th=[ 2165], 90.00th=[ 2366], 95.00th=[ 2567], 00:20:33.867 | 99.00th=[ 3306], 99.50th=[ 3339], 99.90th=[ 3373], 99.95th=[ 3373], 00:20:33.867 | 99.99th=[ 3373] 00:20:33.867 bw ( KiB/s): min= 4096, max=272384, per=2.76%, avg=100760.07, stdev=64380.76, samples=14 00:20:33.867 iops : min= 4, max= 266, avg=98.29, stdev=62.87, samples=14 00:20:33.867 lat (msec) : 100=0.61%, 250=4.29%, 500=14.22%, 750=10.17%, 1000=6.99% 00:20:33.867 lat (msec) : 2000=40.44%, >=2000=23.28% 00:20:33.867 cpu : usr=0.04%, sys=1.55%, ctx=1103, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=3.9%, >=64=92.3% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.867 issued rwts: total=816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.867 job4: (groupid=0, jobs=1): err= 0: pid=3565316: Fri Apr 26 15:08:14 2024 00:20:33.867 read: IOPS=48, BW=48.3MiB/s (50.6MB/s)(512MiB/10603msec) 00:20:33.867 slat (usec): min=30, max=2115.7k, avg=20703.49, stdev=135422.59 00:20:33.867 clat (usec): min=546, max=5313.7k, avg=2058254.45, stdev=1305360.09 00:20:33.867 lat (msec): min=909, max=5316, avg=2078.96, stdev=1308.03 00:20:33.867 clat percentiles (msec): 00:20:33.867 | 1.00th=[ 978], 5.00th=[ 1045], 10.00th=[ 1083], 20.00th=[ 1200], 00:20:33.867 | 30.00th=[ 1284], 40.00th=[ 1385], 50.00th=[ 1469], 60.00th=[ 1770], 00:20:33.867 | 70.00th=[ 2056], 80.00th=[ 2534], 90.00th=[ 5201], 95.00th=[ 5269], 00:20:33.867 | 99.00th=[ 5269], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], 00:20:33.867 | 99.99th=[ 5336] 00:20:33.867 bw ( KiB/s): min=43008, max=147456, per=2.39%, avg=87381.33, stdev=37456.57, samples=9 00:20:33.867 iops : min= 42, max= 144, avg=85.33, stdev=36.58, samples=9 00:20:33.867 lat (usec) : 750=0.20% 00:20:33.867 lat (msec) : 1000=1.37%, 2000=66.02%, >=2000=32.42% 00:20:33.867 cpu : usr=0.00%, sys=1.32%, ctx=884, majf=0, minf=32769 00:20:33.867 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.7% 00:20:33.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.867 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.867 issued rwts: total=512,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job4: (groupid=0, jobs=1): err= 0: pid=3565317: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=63, BW=63.5MiB/s (66.5MB/s)(637MiB/10038msec) 00:20:33.868 slat (usec): min=28, max=2062.0k, avg=15715.90, stdev=107794.51 00:20:33.868 clat (msec): min=23, max=6202, avg=1043.54, stdev=689.06 00:20:33.868 lat (msec): min=58, max=6207, avg=1059.25, stdev=718.90 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 67], 5.00th=[ 199], 10.00th=[ 409], 20.00th=[ 667], 00:20:33.868 | 30.00th=[ 793], 40.00th=[ 902], 50.00th=[ 995], 60.00th=[ 1070], 00:20:33.868 | 70.00th=[ 1133], 80.00th=[ 1200], 90.00th=[ 1636], 95.00th=[ 1955], 00:20:33.868 | 99.00th=[ 4329], 99.50th=[ 6074], 99.90th=[ 6208], 99.95th=[ 6208], 00:20:33.868 | 99.99th=[ 6208] 00:20:33.868 bw ( KiB/s): min=71823, max=212992, per=3.56%, avg=130233.12, stdev=46054.22, samples=8 00:20:33.868 iops : min= 70, max= 208, avg=127.12, stdev=44.96, samples=8 00:20:33.868 lat (msec) : 50=0.16%, 100=2.51%, 250=4.71%, 500=4.87%, 750=13.66% 00:20:33.868 lat (msec) : 1000=25.12%, 2000=44.90%, >=2000=4.08% 00:20:33.868 cpu : usr=0.04%, sys=0.98%, ctx=1268, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.868 issued rwts: total=637,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job4: (groupid=0, jobs=1): err= 0: pid=3565319: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=60, BW=60.4MiB/s (63.3MB/s)(609MiB/10086msec) 00:20:33.868 slat (usec): min=27, max=2064.2k, avg=16442.97, stdev=110615.09 00:20:33.868 clat (msec): min=68, max=5357, avg=1382.01, stdev=1016.30 00:20:33.868 lat (msec): min=101, max=5369, avg=1398.45, stdev=1028.12 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 107], 5.00th=[ 226], 10.00th=[ 667], 20.00th=[ 911], 00:20:33.868 | 30.00th=[ 978], 40.00th=[ 1116], 50.00th=[ 1234], 60.00th=[ 1301], 00:20:33.868 | 70.00th=[ 1435], 80.00th=[ 1586], 90.00th=[ 1687], 95.00th=[ 5201], 00:20:33.868 | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], 00:20:33.868 | 99.99th=[ 5336] 00:20:33.868 bw ( KiB/s): min=49152, max=169984, per=2.69%, avg=98508.80, stdev=37446.62, samples=10 00:20:33.868 iops : min= 48, max= 166, avg=96.20, stdev=36.57, samples=10 00:20:33.868 lat (msec) : 100=0.16%, 250=6.08%, 500=2.46%, 750=1.81%, 1000=21.35% 00:20:33.868 lat (msec) : 2000=62.23%, >=2000=5.91% 00:20:33.868 cpu : usr=0.00%, sys=1.20%, ctx=1311, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.7% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.868 issued rwts: total=609,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job4: (groupid=0, jobs=1): err= 0: pid=3565320: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=62, BW=63.0MiB/s (66.0MB/s)(630MiB/10007msec) 00:20:33.868 slat (usec): min=28, max=2076.5k, avg=15868.65, stdev=137958.20 00:20:33.868 clat (msec): min=6, max=4778, avg=1253.95, stdev=1341.14 00:20:33.868 lat (msec): min=9, max=4800, avg=1269.82, stdev=1352.00 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 20], 5.00th=[ 45], 10.00th=[ 125], 20.00th=[ 439], 00:20:33.868 | 30.00th=[ 472], 40.00th=[ 527], 50.00th=[ 558], 60.00th=[ 693], 00:20:33.868 | 70.00th=[ 1099], 80.00th=[ 3071], 90.00th=[ 3641], 95.00th=[ 3708], 00:20:33.868 | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], 00:20:33.868 | 99.99th=[ 4799] 00:20:33.868 bw ( KiB/s): min=24576, max=284672, per=2.98%, avg=108836.57, stdev=92978.81, samples=7 00:20:33.868 iops : min= 24, max= 278, avg=106.29, stdev=90.80, samples=7 00:20:33.868 lat (msec) : 10=0.48%, 20=0.79%, 50=4.44%, 100=2.38%, 250=7.30% 00:20:33.868 lat (msec) : 500=21.90%, 750=23.02%, 1000=8.73%, 2000=7.46%, >=2000=23.49% 00:20:33.868 cpu : usr=0.02%, sys=1.16%, ctx=852, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.1%, >=64=90.0% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.868 issued rwts: total=630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job4: (groupid=0, jobs=1): err= 0: pid=3565321: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=30, BW=30.9MiB/s (32.4MB/s)(310MiB/10023msec) 00:20:33.868 slat (usec): min=25, max=2274.7k, avg=32264.11, stdev=199001.92 00:20:33.868 clat (msec): min=19, max=5329, avg=2324.82, stdev=1731.14 00:20:33.868 lat (msec): min=22, max=5342, avg=2357.09, stdev=1742.74 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 29], 5.00th=[ 54], 10.00th=[ 108], 20.00th=[ 435], 00:20:33.868 | 30.00th=[ 986], 40.00th=[ 1385], 50.00th=[ 1787], 60.00th=[ 3910], 00:20:33.868 | 70.00th=[ 4144], 80.00th=[ 4212], 90.00th=[ 4329], 95.00th=[ 4396], 00:20:33.868 | 99.00th=[ 4463], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], 00:20:33.868 | 99.99th=[ 5336] 00:20:33.868 bw ( KiB/s): min=14336, max=65536, per=1.06%, avg=38570.67, stdev=19957.93, samples=6 00:20:33.868 iops : min= 14, max= 64, avg=37.67, stdev=19.49, samples=6 00:20:33.868 lat (msec) : 20=0.32%, 50=3.55%, 100=5.16%, 250=6.45%, 500=6.77% 00:20:33.868 lat (msec) : 750=4.52%, 1000=4.19%, 2000=25.16%, >=2000=43.87% 00:20:33.868 cpu : usr=0.01%, sys=0.78%, ctx=725, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.3%, 2=0.6%, 4=1.3%, 8=2.6%, 16=5.2%, 32=10.3%, >=64=79.7% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.868 issued rwts: total=310,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job5: (groupid=0, jobs=1): err= 0: pid=3565329: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=84, BW=84.3MiB/s (88.4MB/s)(973MiB/11540msec) 00:20:33.868 slat (usec): min=24, max=2173.0k, avg=10733.89, stdev=71410.24 00:20:33.868 clat (msec): min=409, max=4895, avg=1409.03, stdev=1190.01 00:20:33.868 lat (msec): min=409, max=4897, avg=1419.76, stdev=1193.84 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 439], 5.00th=[ 489], 10.00th=[ 523], 20.00th=[ 584], 00:20:33.868 | 30.00th=[ 701], 40.00th=[ 802], 50.00th=[ 860], 60.00th=[ 1020], 00:20:33.868 | 70.00th=[ 1636], 80.00th=[ 1838], 90.00th=[ 3742], 95.00th=[ 4530], 00:20:33.868 | 99.00th=[ 4732], 99.50th=[ 4799], 99.90th=[ 4866], 99.95th=[ 4866], 00:20:33.868 | 99.99th=[ 4866] 00:20:33.868 bw ( KiB/s): min= 1868, max=245760, per=3.16%, avg=115495.20, stdev=75845.84, samples=15 00:20:33.868 iops : min= 1, max= 240, avg=112.73, stdev=74.16, samples=15 00:20:33.868 lat (msec) : 500=6.99%, 750=27.85%, 1000=23.64%, 2000=28.47%, >=2000=13.05% 00:20:33.868 cpu : usr=0.06%, sys=1.19%, ctx=1487, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.5% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.868 issued rwts: total=973,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job5: (groupid=0, jobs=1): err= 0: pid=3565330: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=33, BW=33.9MiB/s (35.5MB/s)(340MiB/10043msec) 00:20:33.868 slat (usec): min=29, max=2108.9k, avg=29458.67, stdev=133150.74 00:20:33.868 clat (msec): min=24, max=6334, avg=2600.47, stdev=1846.79 00:20:33.868 lat (msec): min=46, max=6342, avg=2629.93, stdev=1857.66 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 88], 5.00th=[ 167], 10.00th=[ 651], 20.00th=[ 1401], 00:20:33.868 | 30.00th=[ 1653], 40.00th=[ 1871], 50.00th=[ 2005], 60.00th=[ 2165], 00:20:33.868 | 70.00th=[ 2232], 80.00th=[ 5269], 90.00th=[ 5671], 95.00th=[ 6007], 00:20:33.868 | 99.00th=[ 6208], 99.50th=[ 6342], 99.90th=[ 6342], 99.95th=[ 6342], 00:20:33.868 | 99.99th=[ 6342] 00:20:33.868 bw ( KiB/s): min=16351, max=94208, per=1.49%, avg=54429.75, stdev=28392.43, samples=8 00:20:33.868 iops : min= 15, max= 92, avg=53.00, stdev=27.90, samples=8 00:20:33.868 lat (msec) : 50=0.88%, 100=1.18%, 250=4.12%, 500=2.35%, 750=2.35% 00:20:33.868 lat (msec) : 1000=5.88%, 2000=32.65%, >=2000=50.59% 00:20:33.868 cpu : usr=0.01%, sys=0.77%, ctx=967, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.7%, 32=9.4%, >=64=81.5% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:20:33.868 issued rwts: total=340,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job5: (groupid=0, jobs=1): err= 0: pid=3565331: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=61, BW=61.8MiB/s (64.8MB/s)(661MiB/10700msec) 00:20:33.868 slat (usec): min=30, max=2087.6k, avg=16067.24, stdev=117458.32 00:20:33.868 clat (msec): min=75, max=4311, avg=1972.17, stdev=1098.57 00:20:33.868 lat (msec): min=715, max=4318, avg=1988.24, stdev=1099.53 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 726], 5.00th=[ 743], 10.00th=[ 776], 20.00th=[ 919], 00:20:33.868 | 30.00th=[ 1200], 40.00th=[ 1284], 50.00th=[ 1485], 60.00th=[ 2232], 00:20:33.868 | 70.00th=[ 2668], 80.00th=[ 3071], 90.00th=[ 3977], 95.00th=[ 4010], 00:20:33.868 | 99.00th=[ 4111], 99.50th=[ 4178], 99.90th=[ 4329], 99.95th=[ 4329], 00:20:33.868 | 99.99th=[ 4329] 00:20:33.868 bw ( KiB/s): min= 2052, max=188416, per=2.13%, avg=78023.50, stdev=59913.37, samples=14 00:20:33.868 iops : min= 2, max= 184, avg=76.07, stdev=58.42, samples=14 00:20:33.868 lat (msec) : 100=0.15%, 750=6.96%, 1000=19.21%, 2000=28.59%, >=2000=45.08% 00:20:33.868 cpu : usr=0.06%, sys=1.54%, ctx=1045, majf=0, minf=32769 00:20:33.868 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:20:33.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.868 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.868 issued rwts: total=661,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.868 job5: (groupid=0, jobs=1): err= 0: pid=3565332: Fri Apr 26 15:08:14 2024 00:20:33.868 read: IOPS=41, BW=41.4MiB/s (43.4MB/s)(415MiB/10034msec) 00:20:33.868 slat (usec): min=33, max=2091.7k, avg=24092.24, stdev=105865.56 00:20:33.868 clat (msec): min=33, max=6156, avg=2385.53, stdev=1903.05 00:20:33.868 lat (msec): min=35, max=6203, avg=2409.62, stdev=1913.31 00:20:33.868 clat percentiles (msec): 00:20:33.868 | 1.00th=[ 37], 5.00th=[ 78], 10.00th=[ 148], 20.00th=[ 368], 00:20:33.868 | 30.00th=[ 1116], 40.00th=[ 1871], 50.00th=[ 2072], 60.00th=[ 2333], 00:20:33.869 | 70.00th=[ 2534], 80.00th=[ 4665], 90.00th=[ 5470], 95.00th=[ 5805], 00:20:33.869 | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], 00:20:33.869 | 99.99th=[ 6141] 00:20:33.869 bw ( KiB/s): min=24576, max=216310, per=1.99%, avg=72862.75, stdev=62034.62, samples=8 00:20:33.869 iops : min= 24, max= 211, avg=71.12, stdev=60.50, samples=8 00:20:33.869 lat (msec) : 50=2.17%, 100=4.10%, 250=8.43%, 500=11.57%, 750=1.45% 00:20:33.869 lat (msec) : 1000=1.20%, 2000=19.04%, >=2000=52.05% 00:20:33.869 cpu : usr=0.04%, sys=0.99%, ctx=1046, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.9%, 32=7.7%, >=64=84.8% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.869 issued rwts: total=415,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565333: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=51, BW=51.8MiB/s (54.3MB/s)(606MiB/11696msec) 00:20:33.869 slat (usec): min=24, max=2144.9k, avg=16530.66, stdev=90921.49 00:20:33.869 clat (msec): min=1084, max=4120, avg=2329.45, stdev=886.79 00:20:33.869 lat (msec): min=1084, max=4122, avg=2345.98, stdev=888.92 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 1099], 5.00th=[ 1183], 10.00th=[ 1250], 20.00th=[ 1418], 00:20:33.869 | 30.00th=[ 1502], 40.00th=[ 1854], 50.00th=[ 2198], 60.00th=[ 2534], 00:20:33.869 | 70.00th=[ 3037], 80.00th=[ 3339], 90.00th=[ 3507], 95.00th=[ 3608], 00:20:33.869 | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], 00:20:33.869 | 99.99th=[ 4111] 00:20:33.869 bw ( KiB/s): min= 1556, max=133120, per=1.68%, avg=61266.12, stdev=35063.71, samples=16 00:20:33.869 iops : min= 1, max= 130, avg=59.69, stdev=34.31, samples=16 00:20:33.869 lat (msec) : 2000=43.23%, >=2000=56.77% 00:20:33.869 cpu : usr=0.02%, sys=1.15%, ctx=957, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.869 issued rwts: total=606,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565334: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=50, BW=50.6MiB/s (53.1MB/s)(508MiB/10041msec) 00:20:33.869 slat (usec): min=23, max=530405, avg=19710.98, stdev=37277.66 00:20:33.869 clat (msec): min=24, max=4741, avg=2129.14, stdev=1225.75 00:20:33.869 lat (msec): min=46, max=4762, avg=2148.85, stdev=1227.88 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 114], 5.00th=[ 592], 10.00th=[ 609], 20.00th=[ 793], 00:20:33.869 | 30.00th=[ 1401], 40.00th=[ 1502], 50.00th=[ 1938], 60.00th=[ 2500], 00:20:33.869 | 70.00th=[ 2937], 80.00th=[ 3138], 90.00th=[ 3876], 95.00th=[ 4463], 00:20:33.869 | 99.00th=[ 4665], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], 00:20:33.869 | 99.99th=[ 4732] 00:20:33.869 bw ( KiB/s): min= 4096, max=194560, per=1.52%, avg=55695.50, stdev=54858.60, samples=14 00:20:33.869 iops : min= 4, max= 190, avg=54.36, stdev=53.58, samples=14 00:20:33.869 lat (msec) : 50=0.39%, 100=0.59%, 250=1.38%, 500=1.77%, 750=14.76% 00:20:33.869 lat (msec) : 1000=3.35%, 2000=29.53%, >=2000=48.23% 00:20:33.869 cpu : usr=0.04%, sys=0.95%, ctx=1318, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.6% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.869 issued rwts: total=508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565335: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=21, BW=21.7MiB/s (22.7MB/s)(227MiB/10478msec) 00:20:33.869 slat (usec): min=34, max=2047.0k, avg=45801.43, stdev=192908.96 00:20:33.869 clat (msec): min=79, max=6437, avg=4483.74, stdev=1221.21 00:20:33.869 lat (msec): min=1856, max=6446, avg=4529.54, stdev=1197.98 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 1921], 5.00th=[ 2165], 10.00th=[ 2635], 20.00th=[ 3406], 00:20:33.869 | 30.00th=[ 3809], 40.00th=[ 4329], 50.00th=[ 4597], 60.00th=[ 5067], 00:20:33.869 | 70.00th=[ 5336], 80.00th=[ 5537], 90.00th=[ 5873], 95.00th=[ 6141], 00:20:33.869 | 99.00th=[ 6409], 99.50th=[ 6409], 99.90th=[ 6409], 99.95th=[ 6409], 00:20:33.869 | 99.99th=[ 6409] 00:20:33.869 bw ( KiB/s): min= 8192, max=59392, per=0.79%, avg=28964.57, stdev=18026.61, samples=7 00:20:33.869 iops : min= 8, max= 58, avg=28.29, stdev=17.60, samples=7 00:20:33.869 lat (msec) : 100=0.44%, 2000=2.20%, >=2000=97.36% 00:20:33.869 cpu : usr=0.01%, sys=0.77%, ctx=788, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.4%, 2=0.9%, 4=1.8%, 8=3.5%, 16=7.0%, 32=14.1%, >=64=72.2% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.0% 00:20:33.869 issued rwts: total=227,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565336: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=76, BW=76.6MiB/s (80.3MB/s)(799MiB/10430msec) 00:20:33.869 slat (usec): min=26, max=1842.3k, avg=12994.07, stdev=91308.97 00:20:33.869 clat (msec): min=44, max=4167, avg=1590.03, stdev=1055.82 00:20:33.869 lat (msec): min=328, max=4167, avg=1603.02, stdev=1057.81 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 338], 5.00th=[ 405], 10.00th=[ 592], 20.00th=[ 768], 00:20:33.869 | 30.00th=[ 852], 40.00th=[ 1011], 50.00th=[ 1150], 60.00th=[ 1385], 00:20:33.869 | 70.00th=[ 2106], 80.00th=[ 2265], 90.00th=[ 3239], 95.00th=[ 4010], 00:20:33.869 | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4178], 99.95th=[ 4178], 00:20:33.869 | 99.99th=[ 4178] 00:20:33.869 bw ( KiB/s): min=24576, max=305152, per=2.69%, avg=98157.71, stdev=76694.23, samples=14 00:20:33.869 iops : min= 24, max= 298, avg=95.86, stdev=74.90, samples=14 00:20:33.869 lat (msec) : 50=0.13%, 500=8.64%, 750=10.76%, 1000=19.65%, 2000=28.16% 00:20:33.869 lat (msec) : >=2000=32.67% 00:20:33.869 cpu : usr=0.03%, sys=1.02%, ctx=1357, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.1% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.869 issued rwts: total=799,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565337: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=71, BW=71.9MiB/s (75.4MB/s)(727MiB/10111msec) 00:20:33.869 slat (usec): min=27, max=2091.7k, avg=13806.46, stdev=80677.63 00:20:33.869 clat (msec): min=69, max=6012, avg=1508.92, stdev=1726.63 00:20:33.869 lat (msec): min=113, max=6102, avg=1522.72, stdev=1737.03 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 211], 5.00th=[ 388], 10.00th=[ 418], 20.00th=[ 464], 00:20:33.869 | 30.00th=[ 502], 40.00th=[ 592], 50.00th=[ 718], 60.00th=[ 844], 00:20:33.869 | 70.00th=[ 1045], 80.00th=[ 2106], 90.00th=[ 5336], 95.00th=[ 5604], 00:20:33.869 | 99.00th=[ 5940], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], 00:20:33.869 | 99.99th=[ 6007] 00:20:33.869 bw ( KiB/s): min=22528, max=266240, per=3.36%, avg=122675.20, stdev=84977.33, samples=10 00:20:33.869 iops : min= 22, max= 260, avg=119.80, stdev=82.99, samples=10 00:20:33.869 lat (msec) : 100=0.14%, 250=0.96%, 500=27.92%, 750=26.55%, 1000=10.87% 00:20:33.869 lat (msec) : 2000=12.38%, >=2000=21.18% 00:20:33.869 cpu : usr=0.04%, sys=1.43%, ctx=1051, majf=0, minf=32769 00:20:33.869 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.4%, >=64=91.3% 00:20:33.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.869 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:20:33.869 issued rwts: total=727,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.869 job5: (groupid=0, jobs=1): err= 0: pid=3565339: Fri Apr 26 15:08:14 2024 00:20:33.869 read: IOPS=47, BW=47.4MiB/s (49.7MB/s)(478MiB/10075msec) 00:20:33.869 slat (usec): min=23, max=2119.0k, avg=20989.52, stdev=147282.13 00:20:33.869 clat (msec): min=39, max=6824, avg=1635.60, stdev=1747.33 00:20:33.869 lat (msec): min=79, max=6826, avg=1656.59, stdev=1762.20 00:20:33.869 clat percentiles (msec): 00:20:33.869 | 1.00th=[ 87], 5.00th=[ 142], 10.00th=[ 236], 20.00th=[ 334], 00:20:33.869 | 30.00th=[ 485], 40.00th=[ 810], 50.00th=[ 1020], 60.00th=[ 1435], 00:20:33.869 | 70.00th=[ 1854], 80.00th=[ 2123], 90.00th=[ 4933], 95.00th=[ 6544], 00:20:33.869 | 99.00th=[ 6812], 99.50th=[ 6812], 99.90th=[ 6812], 99.95th=[ 6812], 00:20:33.869 | 99.99th=[ 6812] 00:20:33.869 bw ( KiB/s): min=38912, max=299008, per=2.80%, avg=102400.00, stdev=90073.20, samples=7 00:20:33.869 iops : min= 38, max= 292, avg=100.00, stdev=87.96, samples=7 00:20:33.869 lat (msec) : 50=0.21%, 100=0.84%, 250=9.21%, 500=21.13%, 750=3.97% 00:20:33.869 lat (msec) : 1000=14.23%, 2000=25.73%, >=2000=24.69% 00:20:33.870 cpu : usr=0.00%, sys=0.88%, ctx=718, majf=0, minf=32769 00:20:33.870 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.7%, >=64=86.8% 00:20:33.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.870 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:20:33.870 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.870 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.870 job5: (groupid=0, jobs=1): err= 0: pid=3565340: Fri Apr 26 15:08:14 2024 00:20:33.870 read: IOPS=121, BW=121MiB/s (127MB/s)(1299MiB/10728msec) 00:20:33.870 slat (usec): min=22, max=2099.2k, avg=8192.67, stdev=59702.11 00:20:33.870 clat (msec): min=79, max=2755, avg=962.09, stdev=653.28 00:20:33.870 lat (msec): min=350, max=2757, avg=970.28, stdev=654.60 00:20:33.870 clat percentiles (msec): 00:20:33.870 | 1.00th=[ 368], 5.00th=[ 430], 10.00th=[ 468], 20.00th=[ 527], 00:20:33.870 | 30.00th=[ 592], 40.00th=[ 659], 50.00th=[ 718], 60.00th=[ 768], 00:20:33.870 | 70.00th=[ 885], 80.00th=[ 1099], 90.00th=[ 2333], 95.00th=[ 2500], 00:20:33.870 | 99.00th=[ 2702], 99.50th=[ 2735], 99.90th=[ 2769], 99.95th=[ 2769], 00:20:33.870 | 99.99th=[ 2769] 00:20:33.870 bw ( KiB/s): min= 8192, max=290235, per=4.68%, avg=171231.00, stdev=77219.40, samples=14 00:20:33.870 iops : min= 8, max= 283, avg=167.14, stdev=75.34, samples=14 00:20:33.870 lat (msec) : 100=0.08%, 500=14.32%, 750=43.49%, 1000=17.09%, 2000=10.32% 00:20:33.870 lat (msec) : >=2000=14.70% 00:20:33.870 cpu : usr=0.07%, sys=1.73%, ctx=1767, majf=0, minf=32206 00:20:33.870 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.5%, >=64=95.2% 00:20:33.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.870 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.870 issued rwts: total=1299,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.870 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.870 job5: (groupid=0, jobs=1): err= 0: pid=3565341: Fri Apr 26 15:08:14 2024 00:20:33.870 read: IOPS=105, BW=105MiB/s (110MB/s)(1109MiB/10531msec) 00:20:33.870 slat (usec): min=26, max=2084.6k, avg=9419.31, stdev=64094.29 00:20:33.870 clat (msec): min=79, max=2893, avg=1122.67, stdev=611.63 00:20:33.870 lat (msec): min=372, max=2933, avg=1132.09, stdev=612.00 00:20:33.870 clat percentiles (msec): 00:20:33.870 | 1.00th=[ 388], 5.00th=[ 451], 10.00th=[ 531], 20.00th=[ 642], 00:20:33.870 | 30.00th=[ 768], 40.00th=[ 885], 50.00th=[ 1011], 60.00th=[ 1062], 00:20:33.870 | 70.00th=[ 1200], 80.00th=[ 1385], 90.00th=[ 2366], 95.00th=[ 2635], 00:20:33.870 | 99.00th=[ 2836], 99.50th=[ 2869], 99.90th=[ 2903], 99.95th=[ 2903], 00:20:33.870 | 99.99th=[ 2903] 00:20:33.870 bw ( KiB/s): min= 2048, max=272384, per=3.44%, avg=125696.00, stdev=66324.33, samples=16 00:20:33.870 iops : min= 2, max= 266, avg=122.75, stdev=64.77, samples=16 00:20:33.870 lat (msec) : 100=0.09%, 500=7.84%, 750=19.93%, 1000=21.19%, 2000=39.50% 00:20:33.870 lat (msec) : >=2000=11.45% 00:20:33.870 cpu : usr=0.04%, sys=1.34%, ctx=1624, majf=0, minf=32769 00:20:33.870 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.9%, >=64=94.3% 00:20:33.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.870 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.870 issued rwts: total=1109,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.870 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.870 job5: (groupid=0, jobs=1): err= 0: pid=3565342: Fri Apr 26 15:08:14 2024 00:20:33.870 read: IOPS=89, BW=89.2MiB/s (93.6MB/s)(1047MiB/11733msec) 00:20:33.870 slat (usec): min=23, max=1967.6k, avg=11173.60, stdev=63664.51 00:20:33.870 clat (msec): min=27, max=2720, avg=1345.34, stdev=606.24 00:20:33.870 lat (msec): min=551, max=2722, avg=1356.51, stdev=606.08 00:20:33.870 clat percentiles (msec): 00:20:33.870 | 1.00th=[ 558], 5.00th=[ 592], 10.00th=[ 600], 20.00th=[ 684], 00:20:33.870 | 30.00th=[ 776], 40.00th=[ 986], 50.00th=[ 1469], 60.00th=[ 1653], 00:20:33.870 | 70.00th=[ 1737], 80.00th=[ 1804], 90.00th=[ 2165], 95.00th=[ 2400], 00:20:33.870 | 99.00th=[ 2635], 99.50th=[ 2702], 99.90th=[ 2735], 99.95th=[ 2735], 00:20:33.870 | 99.99th=[ 2735] 00:20:33.870 bw ( KiB/s): min=36864, max=223232, per=3.03%, avg=110712.47, stdev=60413.70, samples=17 00:20:33.870 iops : min= 36, max= 218, avg=108.12, stdev=59.00, samples=17 00:20:33.870 lat (msec) : 50=0.10%, 750=27.60%, 1000=12.70%, 2000=47.95%, >=2000=11.65% 00:20:33.870 cpu : usr=0.03%, sys=1.62%, ctx=1207, majf=0, minf=32769 00:20:33.870 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.1%, >=64=94.0% 00:20:33.870 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:33.870 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:33.870 issued rwts: total=1047,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:33.870 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:33.870 00:20:33.870 Run status group 0 (all jobs): 00:20:33.870 READ: bw=3570MiB/s (3743MB/s), 2742KiB/s-149MiB/s (2808kB/s-157MB/s), io=40.9GiB (43.9GB), run=10007-11733msec 00:20:33.870 00:20:33.870 Disk stats (read/write): 00:20:33.870 nvme0n1: ios=59970/0, merge=0/0, ticks=6449051/0, in_queue=6449051, util=97.21% 00:20:33.870 nvme1n1: ios=63423/0, merge=0/0, ticks=7679646/0, in_queue=7679646, util=98.50% 00:20:33.870 nvme2n1: ios=43024/0, merge=0/0, ticks=6204570/0, in_queue=6204570, util=98.63% 00:20:33.870 nvme3n1: ios=38271/0, merge=0/0, ticks=6270825/0, in_queue=6270825, util=98.56% 00:20:33.870 nvme4n1: ios=55356/0, merge=0/0, ticks=6987857/0, in_queue=6987857, util=98.90% 00:20:33.870 nvme5n1: ios=73388/0, merge=0/0, ticks=7241821/0, in_queue=7241821, util=99.11% 00:20:34.134 15:08:14 -- target/srq_overwhelm.sh@38 -- # sync 00:20:34.134 15:08:14 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:20:34.134 15:08:14 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:34.134 15:08:14 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:20:37.449 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:20:37.449 15:08:18 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:20:37.449 15:08:18 -- common/autotest_common.sh@1215 -- # local i=0 00:20:37.449 15:08:18 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:37.449 15:08:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000000 00:20:37.449 15:08:18 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:37.449 15:08:18 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000000 00:20:37.449 15:08:18 -- common/autotest_common.sh@1227 -- # return 0 00:20:37.449 15:08:18 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:20:37.449 15:08:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:37.449 15:08:18 -- common/autotest_common.sh@10 -- # set +x 00:20:37.449 15:08:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:37.449 15:08:18 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:37.449 15:08:18 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:40.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:40.837 15:08:21 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:20:40.837 15:08:21 -- common/autotest_common.sh@1215 -- # local i=0 00:20:40.837 15:08:21 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:40.837 15:08:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000001 00:20:40.837 15:08:21 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000001 00:20:40.837 15:08:21 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:40.837 15:08:21 -- common/autotest_common.sh@1227 -- # return 0 00:20:40.837 15:08:21 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:40.837 15:08:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:40.837 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:20:40.837 15:08:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:40.837 15:08:21 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:40.837 15:08:21 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:45.039 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:45.039 15:08:25 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:20:45.039 15:08:25 -- common/autotest_common.sh@1215 -- # local i=0 00:20:45.039 15:08:25 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:45.039 15:08:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000002 00:20:45.039 15:08:25 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:45.039 15:08:25 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000002 00:20:45.039 15:08:25 -- common/autotest_common.sh@1227 -- # return 0 00:20:45.039 15:08:25 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:45.039 15:08:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:45.039 15:08:25 -- common/autotest_common.sh@10 -- # set +x 00:20:45.039 15:08:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:45.039 15:08:25 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:45.039 15:08:25 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:49.247 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:49.247 15:08:29 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:20:49.247 15:08:29 -- common/autotest_common.sh@1215 -- # local i=0 00:20:49.247 15:08:29 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:49.247 15:08:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000003 00:20:49.247 15:08:29 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:49.247 15:08:29 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000003 00:20:49.247 15:08:29 -- common/autotest_common.sh@1227 -- # return 0 00:20:49.247 15:08:29 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:49.247 15:08:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:49.247 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:20:49.247 15:08:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:49.247 15:08:29 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:49.247 15:08:29 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:53.456 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:53.456 15:08:33 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:20:53.456 15:08:33 -- common/autotest_common.sh@1215 -- # local i=0 00:20:53.456 15:08:33 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:53.456 15:08:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000004 00:20:53.456 15:08:33 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:53.456 15:08:33 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000004 00:20:53.456 15:08:33 -- common/autotest_common.sh@1227 -- # return 0 00:20:53.456 15:08:33 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:53.456 15:08:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:53.456 15:08:33 -- common/autotest_common.sh@10 -- # set +x 00:20:53.456 15:08:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:53.456 15:08:33 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:20:53.456 15:08:33 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:57.665 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:57.665 15:08:37 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:20:57.665 15:08:37 -- common/autotest_common.sh@1215 -- # local i=0 00:20:57.665 15:08:37 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:20:57.665 15:08:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000005 00:20:57.665 15:08:37 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:20:57.665 15:08:37 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000005 00:20:57.665 15:08:38 -- common/autotest_common.sh@1227 -- # return 0 00:20:57.665 15:08:38 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:57.665 15:08:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:57.665 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:20:57.665 15:08:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:57.665 15:08:38 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:20:57.665 15:08:38 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:20:57.665 15:08:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:57.665 15:08:38 -- nvmf/common.sh@117 -- # sync 00:20:57.665 15:08:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:57.665 15:08:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:57.665 15:08:38 -- nvmf/common.sh@120 -- # set +e 00:20:57.665 15:08:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:57.665 15:08:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:57.665 rmmod nvme_rdma 00:20:57.665 rmmod nvme_fabrics 00:20:57.665 15:08:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:57.665 15:08:38 -- nvmf/common.sh@124 -- # set -e 00:20:57.665 15:08:38 -- nvmf/common.sh@125 -- # return 0 00:20:57.665 15:08:38 -- nvmf/common.sh@478 -- # '[' -n 3558206 ']' 00:20:57.665 15:08:38 -- nvmf/common.sh@479 -- # killprocess 3558206 00:20:57.665 15:08:38 -- common/autotest_common.sh@946 -- # '[' -z 3558206 ']' 00:20:57.665 15:08:38 -- common/autotest_common.sh@950 -- # kill -0 3558206 00:20:57.665 15:08:38 -- common/autotest_common.sh@951 -- # uname 00:20:57.665 15:08:38 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:20:57.665 15:08:38 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3558206 00:20:57.665 15:08:38 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:20:57.665 15:08:38 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:20:57.665 15:08:38 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3558206' 00:20:57.665 killing process with pid 3558206 00:20:57.665 15:08:38 -- common/autotest_common.sh@965 -- # kill 3558206 00:20:57.665 15:08:38 -- common/autotest_common.sh@970 -- # wait 3558206 00:20:57.665 [2024-04-26 15:08:38.176962] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:57.665 15:08:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:57.665 15:08:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:57.665 00:20:57.665 real 1m17.297s 00:20:57.665 user 4m52.938s 00:20:57.665 sys 0m17.026s 00:20:57.665 15:08:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:20:57.665 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:20:57.665 ************************************ 00:20:57.665 END TEST nvmf_srq_overwhelm 00:20:57.665 ************************************ 00:20:57.665 15:08:38 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:20:57.665 15:08:38 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:20:57.665 15:08:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:20:57.665 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:20:57.665 ************************************ 00:20:57.665 START TEST nvmf_shutdown 00:20:57.665 ************************************ 00:20:57.665 15:08:38 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:20:57.926 * Looking for test storage... 00:20:57.926 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:20:57.926 15:08:38 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:57.926 15:08:38 -- nvmf/common.sh@7 -- # uname -s 00:20:57.926 15:08:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:57.926 15:08:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:57.926 15:08:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:57.926 15:08:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:57.926 15:08:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:57.926 15:08:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:57.926 15:08:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:57.926 15:08:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:57.926 15:08:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:57.926 15:08:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:57.926 15:08:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:57.926 15:08:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:20:57.926 15:08:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:57.926 15:08:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:57.926 15:08:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:57.926 15:08:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:57.927 15:08:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:57.927 15:08:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:57.927 15:08:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:57.927 15:08:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:57.927 15:08:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.927 15:08:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.927 15:08:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.927 15:08:38 -- paths/export.sh@5 -- # export PATH 00:20:57.927 15:08:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.927 15:08:38 -- nvmf/common.sh@47 -- # : 0 00:20:57.927 15:08:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:57.927 15:08:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:57.927 15:08:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:57.927 15:08:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:57.927 15:08:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:57.927 15:08:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:57.927 15:08:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:57.927 15:08:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:57.927 15:08:38 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:57.927 15:08:38 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:57.927 15:08:38 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:20:57.927 15:08:38 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:20:57.927 15:08:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:20:57.927 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:20:57.927 ************************************ 00:20:57.927 START TEST nvmf_shutdown_tc1 00:20:57.927 ************************************ 00:20:57.927 15:08:38 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc1 00:20:57.927 15:08:38 -- target/shutdown.sh@74 -- # starttarget 00:20:57.927 15:08:38 -- target/shutdown.sh@15 -- # nvmftestinit 00:20:57.927 15:08:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:57.927 15:08:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:57.927 15:08:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:57.927 15:08:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:57.927 15:08:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:57.927 15:08:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:57.927 15:08:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:57.927 15:08:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:57.927 15:08:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:57.927 15:08:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:57.927 15:08:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:57.927 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:21:04.534 15:08:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:04.534 15:08:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:04.534 15:08:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:04.534 15:08:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:04.534 15:08:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:04.534 15:08:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:04.534 15:08:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:04.534 15:08:45 -- nvmf/common.sh@295 -- # net_devs=() 00:21:04.534 15:08:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:04.534 15:08:45 -- nvmf/common.sh@296 -- # e810=() 00:21:04.534 15:08:45 -- nvmf/common.sh@296 -- # local -ga e810 00:21:04.534 15:08:45 -- nvmf/common.sh@297 -- # x722=() 00:21:04.534 15:08:45 -- nvmf/common.sh@297 -- # local -ga x722 00:21:04.534 15:08:45 -- nvmf/common.sh@298 -- # mlx=() 00:21:04.534 15:08:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:04.534 15:08:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:04.534 15:08:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:04.534 15:08:45 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:04.534 15:08:45 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:04.534 15:08:45 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:04.534 15:08:45 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:04.534 15:08:45 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:04.534 15:08:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:04.534 15:08:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:04.534 15:08:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:04.534 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:04.534 15:08:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:04.535 15:08:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:04.535 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:04.535 15:08:45 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:04.535 15:08:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:04.535 15:08:45 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:04.535 15:08:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:04.535 15:08:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:04.535 15:08:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:04.535 Found net devices under 0000:31:00.0: mlx_0_0 00:21:04.535 15:08:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:04.535 15:08:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:04.535 15:08:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:04.535 15:08:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:04.535 15:08:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:04.535 Found net devices under 0000:31:00.1: mlx_0_1 00:21:04.535 15:08:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:04.535 15:08:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:04.535 15:08:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:04.535 15:08:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:04.535 15:08:45 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:04.535 15:08:45 -- nvmf/common.sh@58 -- # uname 00:21:04.535 15:08:45 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:04.535 15:08:45 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:04.535 15:08:45 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:04.535 15:08:45 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:04.535 15:08:45 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:04.535 15:08:45 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:04.535 15:08:45 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:04.535 15:08:45 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:04.535 15:08:45 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:04.535 15:08:45 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:04.535 15:08:45 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:04.535 15:08:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:04.535 15:08:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:04.535 15:08:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:04.535 15:08:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:04.535 15:08:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:04.535 15:08:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:04.535 15:08:45 -- nvmf/common.sh@105 -- # continue 2 00:21:04.535 15:08:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.535 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:04.535 15:08:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:04.535 15:08:45 -- nvmf/common.sh@105 -- # continue 2 00:21:04.535 15:08:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:04.535 15:08:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:04.535 15:08:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:04.797 15:08:45 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:04.797 15:08:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:04.797 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:04.797 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:04.797 altname enp49s0f0np0 00:21:04.797 altname ens786f0np0 00:21:04.797 inet 192.168.100.8/24 scope global mlx_0_0 00:21:04.797 valid_lft forever preferred_lft forever 00:21:04.797 15:08:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:04.797 15:08:45 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:04.797 15:08:45 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:04.797 15:08:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:04.797 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:04.797 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:04.797 altname enp49s0f1np1 00:21:04.797 altname ens786f1np1 00:21:04.797 inet 192.168.100.9/24 scope global mlx_0_1 00:21:04.797 valid_lft forever preferred_lft forever 00:21:04.797 15:08:45 -- nvmf/common.sh@411 -- # return 0 00:21:04.797 15:08:45 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:04.797 15:08:45 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:04.797 15:08:45 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:04.797 15:08:45 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:04.797 15:08:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:04.797 15:08:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:04.797 15:08:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:04.797 15:08:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:04.797 15:08:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:04.797 15:08:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:04.797 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.797 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@105 -- # continue 2 00:21:04.797 15:08:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:04.797 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.797 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:04.797 15:08:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:04.797 15:08:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@105 -- # continue 2 00:21:04.797 15:08:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:04.797 15:08:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:04.797 15:08:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:04.797 15:08:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:04.797 15:08:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:04.797 15:08:45 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:04.797 192.168.100.9' 00:21:04.797 15:08:45 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:04.797 192.168.100.9' 00:21:04.797 15:08:45 -- nvmf/common.sh@446 -- # head -n 1 00:21:04.797 15:08:45 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:04.797 15:08:45 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:04.797 192.168.100.9' 00:21:04.797 15:08:45 -- nvmf/common.sh@447 -- # tail -n +2 00:21:04.797 15:08:45 -- nvmf/common.sh@447 -- # head -n 1 00:21:04.797 15:08:45 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:04.797 15:08:45 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:04.797 15:08:45 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:04.797 15:08:45 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:04.797 15:08:45 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:04.797 15:08:45 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:04.797 15:08:45 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:04.797 15:08:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:04.797 15:08:45 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:04.797 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:21:04.797 15:08:45 -- nvmf/common.sh@470 -- # nvmfpid=3575675 00:21:04.797 15:08:45 -- nvmf/common.sh@471 -- # waitforlisten 3575675 00:21:04.797 15:08:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:04.797 15:08:45 -- common/autotest_common.sh@827 -- # '[' -z 3575675 ']' 00:21:04.797 15:08:45 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:04.797 15:08:45 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:04.797 15:08:45 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:04.797 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:04.797 15:08:45 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:04.797 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:21:04.797 [2024-04-26 15:08:45.675466] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:04.797 [2024-04-26 15:08:45.675532] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:04.797 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.797 [2024-04-26 15:08:45.740160] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:05.058 [2024-04-26 15:08:45.812760] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:05.058 [2024-04-26 15:08:45.812798] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:05.058 [2024-04-26 15:08:45.812807] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:05.058 [2024-04-26 15:08:45.812814] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:05.058 [2024-04-26 15:08:45.812821] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:05.058 [2024-04-26 15:08:45.812956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:05.058 [2024-04-26 15:08:45.813090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:05.058 [2024-04-26 15:08:45.813250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:05.058 [2024-04-26 15:08:45.813251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:05.629 15:08:46 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:05.629 15:08:46 -- common/autotest_common.sh@860 -- # return 0 00:21:05.629 15:08:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:05.629 15:08:46 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:05.629 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:21:05.629 15:08:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:05.629 15:08:46 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:05.629 15:08:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:05.629 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:21:05.629 [2024-04-26 15:08:46.539350] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1065e00/0x106a2f0) succeed. 00:21:05.629 [2024-04-26 15:08:46.554072] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1067440/0x10ab980) succeed. 00:21:05.890 15:08:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:05.890 15:08:46 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:05.890 15:08:46 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:05.890 15:08:46 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:05.890 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:21:05.890 15:08:46 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:05.890 15:08:46 -- target/shutdown.sh@28 -- # cat 00:21:05.890 15:08:46 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:05.890 15:08:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:05.890 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:21:05.890 Malloc1 00:21:05.890 [2024-04-26 15:08:46.784243] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:05.890 Malloc2 00:21:06.152 Malloc3 00:21:06.152 Malloc4 00:21:06.152 Malloc5 00:21:06.152 Malloc6 00:21:06.152 Malloc7 00:21:06.152 Malloc8 00:21:06.152 Malloc9 00:21:06.413 Malloc10 00:21:06.413 15:08:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:06.414 15:08:47 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:06.414 15:08:47 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:06.414 15:08:47 -- common/autotest_common.sh@10 -- # set +x 00:21:06.414 15:08:47 -- target/shutdown.sh@78 -- # perfpid=3575973 00:21:06.414 15:08:47 -- target/shutdown.sh@79 -- # waitforlisten 3575973 /var/tmp/bdevperf.sock 00:21:06.414 15:08:47 -- common/autotest_common.sh@827 -- # '[' -z 3575973 ']' 00:21:06.414 15:08:47 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:06.414 15:08:47 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:06.414 15:08:47 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:06.414 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:06.414 15:08:47 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:06.414 15:08:47 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:06.414 15:08:47 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:06.414 15:08:47 -- common/autotest_common.sh@10 -- # set +x 00:21:06.414 15:08:47 -- nvmf/common.sh@521 -- # config=() 00:21:06.414 15:08:47 -- nvmf/common.sh@521 -- # local subsystem config 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 [2024-04-26 15:08:47.244929] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:06.414 [2024-04-26 15:08:47.245002] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 15:08:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:06.414 { 00:21:06.414 "params": { 00:21:06.414 "name": "Nvme$subsystem", 00:21:06.414 "trtype": "$TEST_TRANSPORT", 00:21:06.414 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:06.414 "adrfam": "ipv4", 00:21:06.414 "trsvcid": "$NVMF_PORT", 00:21:06.414 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:06.414 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:06.414 "hdgst": ${hdgst:-false}, 00:21:06.414 "ddgst": ${ddgst:-false} 00:21:06.414 }, 00:21:06.414 "method": "bdev_nvme_attach_controller" 00:21:06.414 } 00:21:06.414 EOF 00:21:06.414 )") 00:21:06.414 15:08:47 -- nvmf/common.sh@543 -- # cat 00:21:06.414 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.414 15:08:47 -- nvmf/common.sh@545 -- # jq . 00:21:06.415 15:08:47 -- nvmf/common.sh@546 -- # IFS=, 00:21:06.415 15:08:47 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme1", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme2", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme3", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme4", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme5", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme6", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme7", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme8", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme9", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 },{ 00:21:06.415 "params": { 00:21:06.415 "name": "Nvme10", 00:21:06.415 "trtype": "rdma", 00:21:06.415 "traddr": "192.168.100.8", 00:21:06.415 "adrfam": "ipv4", 00:21:06.415 "trsvcid": "4420", 00:21:06.415 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:06.415 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:06.415 "hdgst": false, 00:21:06.415 "ddgst": false 00:21:06.415 }, 00:21:06.415 "method": "bdev_nvme_attach_controller" 00:21:06.415 }' 00:21:06.415 [2024-04-26 15:08:47.306504] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:06.676 [2024-04-26 15:08:47.369962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:07.617 15:08:48 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:07.617 15:08:48 -- common/autotest_common.sh@860 -- # return 0 00:21:07.617 15:08:48 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:07.617 15:08:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:07.617 15:08:48 -- common/autotest_common.sh@10 -- # set +x 00:21:07.617 15:08:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:07.617 15:08:48 -- target/shutdown.sh@83 -- # kill -9 3575973 00:21:07.617 15:08:48 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:07.617 15:08:48 -- target/shutdown.sh@87 -- # sleep 1 00:21:08.561 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3575973 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:21:08.561 15:08:49 -- target/shutdown.sh@88 -- # kill -0 3575675 00:21:08.561 15:08:49 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:21:08.561 15:08:49 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:08.561 15:08:49 -- nvmf/common.sh@521 -- # config=() 00:21:08.561 15:08:49 -- nvmf/common.sh@521 -- # local subsystem config 00:21:08.561 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.561 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.561 { 00:21:08.561 "params": { 00:21:08.561 "name": "Nvme$subsystem", 00:21:08.561 "trtype": "$TEST_TRANSPORT", 00:21:08.561 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.561 "adrfam": "ipv4", 00:21:08.561 "trsvcid": "$NVMF_PORT", 00:21:08.561 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.561 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 [2024-04-26 15:08:49.286792] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:08.562 [2024-04-26 15:08:49.286854] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3576473 ] 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 EAL: No free 2048 kB hugepages reported on node 1 00:21:08.562 15:08:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:08.562 { 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme$subsystem", 00:21:08.562 "trtype": "$TEST_TRANSPORT", 00:21:08.562 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "$NVMF_PORT", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:08.562 "hdgst": ${hdgst:-false}, 00:21:08.562 "ddgst": ${ddgst:-false} 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 } 00:21:08.562 EOF 00:21:08.562 )") 00:21:08.562 15:08:49 -- nvmf/common.sh@543 -- # cat 00:21:08.562 15:08:49 -- nvmf/common.sh@545 -- # jq . 00:21:08.562 15:08:49 -- nvmf/common.sh@546 -- # IFS=, 00:21:08.562 15:08:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme1", 00:21:08.562 "trtype": "rdma", 00:21:08.562 "traddr": "192.168.100.8", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "4420", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:08.562 "hdgst": false, 00:21:08.562 "ddgst": false 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 },{ 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme2", 00:21:08.562 "trtype": "rdma", 00:21:08.562 "traddr": "192.168.100.8", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "4420", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:08.562 "hdgst": false, 00:21:08.562 "ddgst": false 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 },{ 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme3", 00:21:08.562 "trtype": "rdma", 00:21:08.562 "traddr": "192.168.100.8", 00:21:08.562 "adrfam": "ipv4", 00:21:08.562 "trsvcid": "4420", 00:21:08.562 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:08.562 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:08.562 "hdgst": false, 00:21:08.562 "ddgst": false 00:21:08.562 }, 00:21:08.562 "method": "bdev_nvme_attach_controller" 00:21:08.562 },{ 00:21:08.562 "params": { 00:21:08.562 "name": "Nvme4", 00:21:08.562 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme5", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme6", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme7", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme8", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme9", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 },{ 00:21:08.563 "params": { 00:21:08.563 "name": "Nvme10", 00:21:08.563 "trtype": "rdma", 00:21:08.563 "traddr": "192.168.100.8", 00:21:08.563 "adrfam": "ipv4", 00:21:08.563 "trsvcid": "4420", 00:21:08.563 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:08.563 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:08.563 "hdgst": false, 00:21:08.563 "ddgst": false 00:21:08.563 }, 00:21:08.563 "method": "bdev_nvme_attach_controller" 00:21:08.563 }' 00:21:08.563 [2024-04-26 15:08:49.347668] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:08.563 [2024-04-26 15:08:49.410090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:09.506 Running I/O for 1 seconds... 00:21:10.893 00:21:10.893 Latency(us) 00:21:10.893 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.893 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme1n1 : 1.21 279.74 17.48 0.00 0.00 218591.64 18568.53 230686.72 00:21:10.893 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme2n1 : 1.22 313.64 19.60 0.00 0.00 198299.73 14090.24 212336.64 00:21:10.893 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme3n1 : 1.23 323.95 20.25 0.00 0.00 187208.59 3126.61 193112.75 00:21:10.893 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme4n1 : 1.23 322.03 20.13 0.00 0.00 185061.26 6307.84 160781.65 00:21:10.893 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme5n1 : 1.21 316.48 19.78 0.00 0.00 186760.82 28835.84 143305.39 00:21:10.893 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme6n1 : 1.22 315.96 19.75 0.00 0.00 183738.60 29928.11 124955.31 00:21:10.893 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme7n1 : 1.22 315.44 19.71 0.00 0.00 180703.00 30801.92 119712.43 00:21:10.893 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme8n1 : 1.22 314.92 19.68 0.00 0.00 177688.46 31894.19 138936.32 00:21:10.893 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme9n1 : 1.22 314.41 19.65 0.00 0.00 174616.18 32986.45 157286.40 00:21:10.893 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:10.893 Verification LBA range: start 0x0 length 0x400 00:21:10.893 Nvme10n1 : 1.23 208.36 13.02 0.00 0.00 258667.20 5270.19 559240.53 00:21:10.893 =================================================================================================================== 00:21:10.893 Total : 3024.92 189.06 0.00 0.00 192579.29 3126.61 559240.53 00:21:10.893 15:08:51 -- target/shutdown.sh@94 -- # stoptarget 00:21:10.893 15:08:51 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:10.893 15:08:51 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:10.893 15:08:51 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:10.894 15:08:51 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:10.894 15:08:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:10.894 15:08:51 -- nvmf/common.sh@117 -- # sync 00:21:10.894 15:08:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:10.894 15:08:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:10.894 15:08:51 -- nvmf/common.sh@120 -- # set +e 00:21:10.894 15:08:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:10.894 15:08:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:10.894 rmmod nvme_rdma 00:21:10.894 rmmod nvme_fabrics 00:21:10.894 15:08:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:10.894 15:08:51 -- nvmf/common.sh@124 -- # set -e 00:21:10.894 15:08:51 -- nvmf/common.sh@125 -- # return 0 00:21:10.894 15:08:51 -- nvmf/common.sh@478 -- # '[' -n 3575675 ']' 00:21:10.894 15:08:51 -- nvmf/common.sh@479 -- # killprocess 3575675 00:21:10.894 15:08:51 -- common/autotest_common.sh@946 -- # '[' -z 3575675 ']' 00:21:10.894 15:08:51 -- common/autotest_common.sh@950 -- # kill -0 3575675 00:21:10.894 15:08:51 -- common/autotest_common.sh@951 -- # uname 00:21:10.894 15:08:51 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:10.894 15:08:51 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3575675 00:21:11.155 15:08:51 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:21:11.155 15:08:51 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:21:11.155 15:08:51 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3575675' 00:21:11.155 killing process with pid 3575675 00:21:11.155 15:08:51 -- common/autotest_common.sh@965 -- # kill 3575675 00:21:11.155 15:08:51 -- common/autotest_common.sh@970 -- # wait 3575675 00:21:11.155 [2024-04-26 15:08:51.934916] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:11.416 15:08:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:11.416 15:08:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:11.416 00:21:11.416 real 0m13.344s 00:21:11.416 user 0m30.244s 00:21:11.416 sys 0m5.946s 00:21:11.416 15:08:52 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:11.416 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:11.416 ************************************ 00:21:11.416 END TEST nvmf_shutdown_tc1 00:21:11.416 ************************************ 00:21:11.416 15:08:52 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:21:11.416 15:08:52 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:21:11.416 15:08:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:11.416 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:11.416 ************************************ 00:21:11.416 START TEST nvmf_shutdown_tc2 00:21:11.416 ************************************ 00:21:11.416 15:08:52 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc2 00:21:11.416 15:08:52 -- target/shutdown.sh@99 -- # starttarget 00:21:11.416 15:08:52 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:11.416 15:08:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:11.416 15:08:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:11.416 15:08:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:11.416 15:08:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:11.679 15:08:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:11.679 15:08:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:11.679 15:08:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:11.679 15:08:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:11.679 15:08:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:11.679 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:11.679 15:08:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:11.679 15:08:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:11.679 15:08:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:11.679 15:08:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:11.679 15:08:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:11.679 15:08:52 -- nvmf/common.sh@295 -- # net_devs=() 00:21:11.679 15:08:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@296 -- # e810=() 00:21:11.679 15:08:52 -- nvmf/common.sh@296 -- # local -ga e810 00:21:11.679 15:08:52 -- nvmf/common.sh@297 -- # x722=() 00:21:11.679 15:08:52 -- nvmf/common.sh@297 -- # local -ga x722 00:21:11.679 15:08:52 -- nvmf/common.sh@298 -- # mlx=() 00:21:11.679 15:08:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:11.679 15:08:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:11.679 15:08:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:11.679 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:11.679 15:08:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:11.679 15:08:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:11.679 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:11.679 15:08:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:11.679 15:08:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.679 15:08:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.679 15:08:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:11.679 Found net devices under 0000:31:00.0: mlx_0_0 00:21:11.679 15:08:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:11.679 15:08:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:11.679 15:08:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:11.679 Found net devices under 0000:31:00.1: mlx_0_1 00:21:11.679 15:08:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:11.679 15:08:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:11.679 15:08:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:11.679 15:08:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:11.679 15:08:52 -- nvmf/common.sh@58 -- # uname 00:21:11.679 15:08:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:11.679 15:08:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:11.679 15:08:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:11.679 15:08:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:11.679 15:08:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:11.679 15:08:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:11.679 15:08:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:11.679 15:08:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:11.679 15:08:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:11.679 15:08:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:11.679 15:08:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:11.679 15:08:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:11.679 15:08:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:11.679 15:08:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:11.679 15:08:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:11.679 15:08:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.679 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:11.679 15:08:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:11.679 15:08:52 -- nvmf/common.sh@105 -- # continue 2 00:21:11.680 15:08:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@105 -- # continue 2 00:21:11.680 15:08:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:11.680 15:08:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:11.680 15:08:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:11.680 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:11.680 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:11.680 altname enp49s0f0np0 00:21:11.680 altname ens786f0np0 00:21:11.680 inet 192.168.100.8/24 scope global mlx_0_0 00:21:11.680 valid_lft forever preferred_lft forever 00:21:11.680 15:08:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:11.680 15:08:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:11.680 15:08:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:11.680 15:08:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:11.680 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:11.680 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:11.680 altname enp49s0f1np1 00:21:11.680 altname ens786f1np1 00:21:11.680 inet 192.168.100.9/24 scope global mlx_0_1 00:21:11.680 valid_lft forever preferred_lft forever 00:21:11.680 15:08:52 -- nvmf/common.sh@411 -- # return 0 00:21:11.680 15:08:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:11.680 15:08:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:11.680 15:08:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:11.680 15:08:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:11.680 15:08:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:11.680 15:08:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:11.680 15:08:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:11.680 15:08:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:11.680 15:08:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:11.680 15:08:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@105 -- # continue 2 00:21:11.680 15:08:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:11.680 15:08:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:11.680 15:08:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@105 -- # continue 2 00:21:11.680 15:08:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:11.680 15:08:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:11.680 15:08:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:11.680 15:08:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:11.680 15:08:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:11.680 15:08:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:11.680 192.168.100.9' 00:21:11.680 15:08:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:11.680 192.168.100.9' 00:21:11.680 15:08:52 -- nvmf/common.sh@446 -- # head -n 1 00:21:11.680 15:08:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:11.680 15:08:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:11.680 192.168.100.9' 00:21:11.680 15:08:52 -- nvmf/common.sh@447 -- # tail -n +2 00:21:11.680 15:08:52 -- nvmf/common.sh@447 -- # head -n 1 00:21:11.680 15:08:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:11.680 15:08:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:11.680 15:08:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:11.680 15:08:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:11.680 15:08:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:11.680 15:08:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:11.680 15:08:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:11.680 15:08:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:11.680 15:08:52 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:11.680 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:11.680 15:08:52 -- nvmf/common.sh@470 -- # nvmfpid=3577168 00:21:11.680 15:08:52 -- nvmf/common.sh@471 -- # waitforlisten 3577168 00:21:11.680 15:08:52 -- common/autotest_common.sh@827 -- # '[' -z 3577168 ']' 00:21:11.680 15:08:52 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:11.680 15:08:52 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:11.680 15:08:52 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:11.680 15:08:52 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:11.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:11.680 15:08:52 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:11.680 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:11.942 [2024-04-26 15:08:52.656340] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:11.942 [2024-04-26 15:08:52.656394] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:11.942 EAL: No free 2048 kB hugepages reported on node 1 00:21:11.942 [2024-04-26 15:08:52.717157] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:11.942 [2024-04-26 15:08:52.781310] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:11.942 [2024-04-26 15:08:52.781346] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:11.942 [2024-04-26 15:08:52.781359] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:11.942 [2024-04-26 15:08:52.781367] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:11.942 [2024-04-26 15:08:52.781374] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:11.942 [2024-04-26 15:08:52.781544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:11.942 [2024-04-26 15:08:52.781677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:11.942 [2024-04-26 15:08:52.781839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:11.942 [2024-04-26 15:08:52.781840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:11.942 15:08:52 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:11.942 15:08:52 -- common/autotest_common.sh@860 -- # return 0 00:21:11.942 15:08:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:11.942 15:08:52 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:11.942 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:12.204 15:08:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:12.204 15:08:52 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:12.204 15:08:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:12.204 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:21:12.204 [2024-04-26 15:08:52.943503] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xd84e00/0xd892f0) succeed. 00:21:12.204 [2024-04-26 15:08:52.958047] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xd86440/0xdca980) succeed. 00:21:12.204 15:08:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:12.204 15:08:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:12.204 15:08:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:12.204 15:08:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:12.204 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:21:12.204 15:08:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:12.204 15:08:53 -- target/shutdown.sh@28 -- # cat 00:21:12.204 15:08:53 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:12.204 15:08:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:12.204 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:21:12.204 Malloc1 00:21:12.465 [2024-04-26 15:08:53.168366] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:12.465 Malloc2 00:21:12.465 Malloc3 00:21:12.465 Malloc4 00:21:12.465 Malloc5 00:21:12.465 Malloc6 00:21:12.465 Malloc7 00:21:12.727 Malloc8 00:21:12.727 Malloc9 00:21:12.727 Malloc10 00:21:12.727 15:08:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:12.727 15:08:53 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:12.727 15:08:53 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:12.727 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:21:12.727 15:08:53 -- target/shutdown.sh@103 -- # perfpid=3577345 00:21:12.727 15:08:53 -- target/shutdown.sh@104 -- # waitforlisten 3577345 /var/tmp/bdevperf.sock 00:21:12.727 15:08:53 -- common/autotest_common.sh@827 -- # '[' -z 3577345 ']' 00:21:12.727 15:08:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:12.727 15:08:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:12.727 15:08:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:12.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:12.727 15:08:53 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:12.727 15:08:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:12.727 15:08:53 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:12.727 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:21:12.727 15:08:53 -- nvmf/common.sh@521 -- # config=() 00:21:12.727 15:08:53 -- nvmf/common.sh@521 -- # local subsystem config 00:21:12.727 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.727 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.727 { 00:21:12.727 "params": { 00:21:12.727 "name": "Nvme$subsystem", 00:21:12.727 "trtype": "$TEST_TRANSPORT", 00:21:12.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.727 "adrfam": "ipv4", 00:21:12.727 "trsvcid": "$NVMF_PORT", 00:21:12.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.727 "hdgst": ${hdgst:-false}, 00:21:12.727 "ddgst": ${ddgst:-false} 00:21:12.727 }, 00:21:12.727 "method": "bdev_nvme_attach_controller" 00:21:12.727 } 00:21:12.727 EOF 00:21:12.727 )") 00:21:12.727 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.727 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.727 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.727 { 00:21:12.727 "params": { 00:21:12.727 "name": "Nvme$subsystem", 00:21:12.727 "trtype": "$TEST_TRANSPORT", 00:21:12.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.727 "adrfam": "ipv4", 00:21:12.727 "trsvcid": "$NVMF_PORT", 00:21:12.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.727 "hdgst": ${hdgst:-false}, 00:21:12.727 "ddgst": ${ddgst:-false} 00:21:12.727 }, 00:21:12.727 "method": "bdev_nvme_attach_controller" 00:21:12.727 } 00:21:12.727 EOF 00:21:12.727 )") 00:21:12.727 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.727 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.727 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.727 { 00:21:12.727 "params": { 00:21:12.727 "name": "Nvme$subsystem", 00:21:12.727 "trtype": "$TEST_TRANSPORT", 00:21:12.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.727 "adrfam": "ipv4", 00:21:12.727 "trsvcid": "$NVMF_PORT", 00:21:12.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.727 "hdgst": ${hdgst:-false}, 00:21:12.727 "ddgst": ${ddgst:-false} 00:21:12.727 }, 00:21:12.727 "method": "bdev_nvme_attach_controller" 00:21:12.727 } 00:21:12.727 EOF 00:21:12.727 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 [2024-04-26 15:08:53.618030] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:12.728 [2024-04-26 15:08:53.618084] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3577345 ] 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 EAL: No free 2048 kB hugepages reported on node 1 00:21:12.728 15:08:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:12.728 { 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme$subsystem", 00:21:12.728 "trtype": "$TEST_TRANSPORT", 00:21:12.728 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "$NVMF_PORT", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:12.728 "hdgst": ${hdgst:-false}, 00:21:12.728 "ddgst": ${ddgst:-false} 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 } 00:21:12.728 EOF 00:21:12.728 )") 00:21:12.728 15:08:53 -- nvmf/common.sh@543 -- # cat 00:21:12.728 15:08:53 -- nvmf/common.sh@545 -- # jq . 00:21:12.728 15:08:53 -- nvmf/common.sh@546 -- # IFS=, 00:21:12.728 15:08:53 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme1", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme2", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme3", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme4", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme5", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme6", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme7", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.728 },{ 00:21:12.728 "params": { 00:21:12.728 "name": "Nvme8", 00:21:12.728 "trtype": "rdma", 00:21:12.728 "traddr": "192.168.100.8", 00:21:12.728 "adrfam": "ipv4", 00:21:12.728 "trsvcid": "4420", 00:21:12.728 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:12.728 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:12.728 "hdgst": false, 00:21:12.728 "ddgst": false 00:21:12.728 }, 00:21:12.728 "method": "bdev_nvme_attach_controller" 00:21:12.729 },{ 00:21:12.729 "params": { 00:21:12.729 "name": "Nvme9", 00:21:12.729 "trtype": "rdma", 00:21:12.729 "traddr": "192.168.100.8", 00:21:12.729 "adrfam": "ipv4", 00:21:12.729 "trsvcid": "4420", 00:21:12.729 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:12.729 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:12.729 "hdgst": false, 00:21:12.729 "ddgst": false 00:21:12.729 }, 00:21:12.729 "method": "bdev_nvme_attach_controller" 00:21:12.729 },{ 00:21:12.729 "params": { 00:21:12.729 "name": "Nvme10", 00:21:12.729 "trtype": "rdma", 00:21:12.729 "traddr": "192.168.100.8", 00:21:12.729 "adrfam": "ipv4", 00:21:12.729 "trsvcid": "4420", 00:21:12.729 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:12.729 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:12.729 "hdgst": false, 00:21:12.729 "ddgst": false 00:21:12.729 }, 00:21:12.729 "method": "bdev_nvme_attach_controller" 00:21:12.729 }' 00:21:12.990 [2024-04-26 15:08:53.678066] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:12.990 [2024-04-26 15:08:53.740692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:13.933 Running I/O for 10 seconds... 00:21:13.933 15:08:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:13.933 15:08:54 -- common/autotest_common.sh@860 -- # return 0 00:21:13.933 15:08:54 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:13.933 15:08:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:13.933 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:21:13.933 15:08:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:13.933 15:08:54 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:21:13.933 15:08:54 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:21:13.933 15:08:54 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:21:13.933 15:08:54 -- target/shutdown.sh@57 -- # local ret=1 00:21:13.933 15:08:54 -- target/shutdown.sh@58 -- # local i 00:21:13.933 15:08:54 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:21:13.933 15:08:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:13.933 15:08:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:13.933 15:08:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:13.933 15:08:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:13.933 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:21:14.194 15:08:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:14.194 15:08:54 -- target/shutdown.sh@60 -- # read_io_count=3 00:21:14.194 15:08:54 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:21:14.194 15:08:54 -- target/shutdown.sh@67 -- # sleep 0.25 00:21:14.454 15:08:55 -- target/shutdown.sh@59 -- # (( i-- )) 00:21:14.454 15:08:55 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:14.454 15:08:55 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:14.454 15:08:55 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:14.454 15:08:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:14.454 15:08:55 -- common/autotest_common.sh@10 -- # set +x 00:21:14.716 15:08:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:14.716 15:08:55 -- target/shutdown.sh@60 -- # read_io_count=163 00:21:14.716 15:08:55 -- target/shutdown.sh@63 -- # '[' 163 -ge 100 ']' 00:21:14.716 15:08:55 -- target/shutdown.sh@64 -- # ret=0 00:21:14.716 15:08:55 -- target/shutdown.sh@65 -- # break 00:21:14.716 15:08:55 -- target/shutdown.sh@69 -- # return 0 00:21:14.716 15:08:55 -- target/shutdown.sh@110 -- # killprocess 3577345 00:21:14.716 15:08:55 -- common/autotest_common.sh@946 -- # '[' -z 3577345 ']' 00:21:14.716 15:08:55 -- common/autotest_common.sh@950 -- # kill -0 3577345 00:21:14.716 15:08:55 -- common/autotest_common.sh@951 -- # uname 00:21:14.716 15:08:55 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:14.716 15:08:55 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3577345 00:21:14.716 15:08:55 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:21:14.716 15:08:55 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:21:14.716 15:08:55 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3577345' 00:21:14.716 killing process with pid 3577345 00:21:14.716 15:08:55 -- common/autotest_common.sh@965 -- # kill 3577345 00:21:14.716 15:08:55 -- common/autotest_common.sh@970 -- # wait 3577345 00:21:14.716 Received shutdown signal, test time was about 0.985061 seconds 00:21:14.716 00:21:14.716 Latency(us) 00:21:14.716 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:14.716 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme1n1 : 0.97 296.92 18.56 0.00 0.00 211160.18 10267.31 249910.61 00:21:14.716 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme2n1 : 0.97 287.26 17.95 0.00 0.00 213532.95 10540.37 237677.23 00:21:14.716 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme3n1 : 0.97 329.00 20.56 0.00 0.00 182826.84 4123.31 183500.80 00:21:14.716 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme4n1 : 0.97 328.38 20.52 0.00 0.00 180189.35 11741.87 166898.35 00:21:14.716 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme5n1 : 0.98 327.77 20.49 0.00 0.00 176471.21 12615.68 150295.89 00:21:14.716 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme6n1 : 0.98 327.16 20.45 0.00 0.00 172826.54 13489.49 132819.63 00:21:14.716 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme7n1 : 0.98 326.57 20.41 0.00 0.00 168941.91 14199.47 123207.68 00:21:14.716 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme8n1 : 0.98 325.93 20.37 0.00 0.00 165710.85 15182.51 138062.51 00:21:14.716 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme9n1 : 0.98 325.29 20.33 0.00 0.00 162120.62 9775.79 157286.40 00:21:14.716 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:14.716 Verification LBA range: start 0x0 length 0x400 00:21:14.716 Nvme10n1 : 0.97 132.17 8.26 0.00 0.00 387639.47 9775.79 569726.29 00:21:14.716 =================================================================================================================== 00:21:14.716 Total : 3006.45 187.90 0.00 0.00 189749.78 4123.31 569726.29 00:21:14.978 15:08:55 -- target/shutdown.sh@113 -- # sleep 1 00:21:15.923 15:08:56 -- target/shutdown.sh@114 -- # kill -0 3577168 00:21:15.923 15:08:56 -- target/shutdown.sh@116 -- # stoptarget 00:21:15.923 15:08:56 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:15.923 15:08:56 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:15.923 15:08:56 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:15.923 15:08:56 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:15.923 15:08:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:15.923 15:08:56 -- nvmf/common.sh@117 -- # sync 00:21:15.923 15:08:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:15.923 15:08:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:15.923 15:08:56 -- nvmf/common.sh@120 -- # set +e 00:21:15.923 15:08:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:15.923 15:08:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:15.923 rmmod nvme_rdma 00:21:16.183 rmmod nvme_fabrics 00:21:16.183 15:08:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:16.183 15:08:56 -- nvmf/common.sh@124 -- # set -e 00:21:16.183 15:08:56 -- nvmf/common.sh@125 -- # return 0 00:21:16.183 15:08:56 -- nvmf/common.sh@478 -- # '[' -n 3577168 ']' 00:21:16.183 15:08:56 -- nvmf/common.sh@479 -- # killprocess 3577168 00:21:16.183 15:08:56 -- common/autotest_common.sh@946 -- # '[' -z 3577168 ']' 00:21:16.183 15:08:56 -- common/autotest_common.sh@950 -- # kill -0 3577168 00:21:16.183 15:08:56 -- common/autotest_common.sh@951 -- # uname 00:21:16.183 15:08:56 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:16.183 15:08:56 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3577168 00:21:16.183 15:08:56 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:21:16.183 15:08:56 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:21:16.183 15:08:56 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3577168' 00:21:16.183 killing process with pid 3577168 00:21:16.183 15:08:56 -- common/autotest_common.sh@965 -- # kill 3577168 00:21:16.183 15:08:56 -- common/autotest_common.sh@970 -- # wait 3577168 00:21:16.184 [2024-04-26 15:08:57.041873] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:16.444 15:08:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:16.444 15:08:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:16.444 00:21:16.444 real 0m4.933s 00:21:16.444 user 0m20.035s 00:21:16.444 sys 0m0.933s 00:21:16.444 15:08:57 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:16.444 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:21:16.444 ************************************ 00:21:16.444 END TEST nvmf_shutdown_tc2 00:21:16.444 ************************************ 00:21:16.444 15:08:57 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:21:16.444 15:08:57 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:21:16.444 15:08:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:16.444 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:21:16.706 ************************************ 00:21:16.706 START TEST nvmf_shutdown_tc3 00:21:16.706 ************************************ 00:21:16.706 15:08:57 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc3 00:21:16.706 15:08:57 -- target/shutdown.sh@121 -- # starttarget 00:21:16.706 15:08:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:16.706 15:08:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:16.706 15:08:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:16.706 15:08:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:16.706 15:08:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:16.706 15:08:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:16.706 15:08:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:16.706 15:08:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:16.706 15:08:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:16.706 15:08:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:16.706 15:08:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:16.706 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:21:16.706 15:08:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:16.706 15:08:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:16.706 15:08:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:16.706 15:08:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:16.706 15:08:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:16.706 15:08:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:16.706 15:08:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:16.706 15:08:57 -- nvmf/common.sh@295 -- # net_devs=() 00:21:16.706 15:08:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:16.706 15:08:57 -- nvmf/common.sh@296 -- # e810=() 00:21:16.706 15:08:57 -- nvmf/common.sh@296 -- # local -ga e810 00:21:16.706 15:08:57 -- nvmf/common.sh@297 -- # x722=() 00:21:16.706 15:08:57 -- nvmf/common.sh@297 -- # local -ga x722 00:21:16.706 15:08:57 -- nvmf/common.sh@298 -- # mlx=() 00:21:16.706 15:08:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:16.706 15:08:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:16.706 15:08:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:16.706 15:08:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:16.706 15:08:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:16.706 15:08:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:16.706 15:08:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:16.706 15:08:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:16.706 15:08:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:16.706 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:16.706 15:08:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:16.706 15:08:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:16.706 15:08:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:16.706 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:16.706 15:08:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:16.706 15:08:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:16.706 15:08:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:16.706 15:08:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:16.706 15:08:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:16.706 15:08:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:16.706 15:08:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:16.706 15:08:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:16.706 Found net devices under 0000:31:00.0: mlx_0_0 00:21:16.707 15:08:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:16.707 15:08:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:16.707 15:08:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:16.707 15:08:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:16.707 15:08:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:16.707 Found net devices under 0000:31:00.1: mlx_0_1 00:21:16.707 15:08:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:16.707 15:08:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:16.707 15:08:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:16.707 15:08:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:16.707 15:08:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:16.707 15:08:57 -- nvmf/common.sh@58 -- # uname 00:21:16.707 15:08:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:16.707 15:08:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:16.707 15:08:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:16.707 15:08:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:16.707 15:08:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:16.707 15:08:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:16.707 15:08:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:16.707 15:08:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:16.707 15:08:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:16.707 15:08:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:16.707 15:08:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:16.707 15:08:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:16.707 15:08:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:16.707 15:08:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:16.707 15:08:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:16.707 15:08:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:16.707 15:08:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:16.707 15:08:57 -- nvmf/common.sh@105 -- # continue 2 00:21:16.707 15:08:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.707 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:16.707 15:08:57 -- nvmf/common.sh@105 -- # continue 2 00:21:16.707 15:08:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:16.707 15:08:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:16.707 15:08:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:16.707 15:08:57 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:16.707 15:08:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:16.707 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:16.707 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:16.707 altname enp49s0f0np0 00:21:16.707 altname ens786f0np0 00:21:16.707 inet 192.168.100.8/24 scope global mlx_0_0 00:21:16.707 valid_lft forever preferred_lft forever 00:21:16.707 15:08:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:16.707 15:08:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:16.707 15:08:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:16.707 15:08:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:16.707 15:08:57 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:16.707 15:08:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:16.707 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:16.707 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:16.707 altname enp49s0f1np1 00:21:16.707 altname ens786f1np1 00:21:16.707 inet 192.168.100.9/24 scope global mlx_0_1 00:21:16.707 valid_lft forever preferred_lft forever 00:21:16.707 15:08:57 -- nvmf/common.sh@411 -- # return 0 00:21:16.707 15:08:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:16.707 15:08:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:16.707 15:08:57 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:16.707 15:08:57 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:16.707 15:08:57 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:16.707 15:08:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:16.707 15:08:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:16.707 15:08:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:16.707 15:08:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:16.969 15:08:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:16.969 15:08:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:16.969 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.969 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:16.969 15:08:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:16.969 15:08:57 -- nvmf/common.sh@105 -- # continue 2 00:21:16.969 15:08:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:16.969 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.969 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:16.969 15:08:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:16.969 15:08:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:16.969 15:08:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:16.969 15:08:57 -- nvmf/common.sh@105 -- # continue 2 00:21:16.969 15:08:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:16.969 15:08:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:16.969 15:08:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:16.969 15:08:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:16.969 15:08:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:16.969 15:08:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:16.969 15:08:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:16.969 15:08:57 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:16.969 192.168.100.9' 00:21:16.969 15:08:57 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:16.969 192.168.100.9' 00:21:16.969 15:08:57 -- nvmf/common.sh@446 -- # head -n 1 00:21:16.969 15:08:57 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:16.969 15:08:57 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:16.969 192.168.100.9' 00:21:16.969 15:08:57 -- nvmf/common.sh@447 -- # tail -n +2 00:21:16.969 15:08:57 -- nvmf/common.sh@447 -- # head -n 1 00:21:16.969 15:08:57 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:16.969 15:08:57 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:16.969 15:08:57 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:16.969 15:08:57 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:16.969 15:08:57 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:16.969 15:08:57 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:16.969 15:08:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:16.969 15:08:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:16.969 15:08:57 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:16.969 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:21:16.969 15:08:57 -- nvmf/common.sh@470 -- # nvmfpid=3578315 00:21:16.969 15:08:57 -- nvmf/common.sh@471 -- # waitforlisten 3578315 00:21:16.969 15:08:57 -- common/autotest_common.sh@827 -- # '[' -z 3578315 ']' 00:21:16.969 15:08:57 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:16.969 15:08:57 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:16.969 15:08:57 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:16.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:16.969 15:08:57 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:16.969 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:21:16.969 15:08:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:16.969 [2024-04-26 15:08:57.779063] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:16.969 [2024-04-26 15:08:57.779109] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:16.969 EAL: No free 2048 kB hugepages reported on node 1 00:21:16.969 [2024-04-26 15:08:57.839871] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:16.969 [2024-04-26 15:08:57.903110] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:16.969 [2024-04-26 15:08:57.903147] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:16.969 [2024-04-26 15:08:57.903156] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:16.969 [2024-04-26 15:08:57.903164] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:16.969 [2024-04-26 15:08:57.903171] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:16.969 [2024-04-26 15:08:57.903343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:16.969 [2024-04-26 15:08:57.903479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:16.969 [2024-04-26 15:08:57.903636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:16.969 [2024-04-26 15:08:57.903637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:17.932 15:08:58 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:17.932 15:08:58 -- common/autotest_common.sh@860 -- # return 0 00:21:17.932 15:08:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:17.932 15:08:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:17.932 15:08:58 -- common/autotest_common.sh@10 -- # set +x 00:21:17.932 15:08:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:17.932 15:08:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:17.932 15:08:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:17.932 15:08:58 -- common/autotest_common.sh@10 -- # set +x 00:21:17.932 [2024-04-26 15:08:58.628905] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bfbe00/0x1c002f0) succeed. 00:21:17.932 [2024-04-26 15:08:58.643439] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bfd440/0x1c41980) succeed. 00:21:17.932 15:08:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:17.932 15:08:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:17.932 15:08:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:17.932 15:08:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:17.932 15:08:58 -- common/autotest_common.sh@10 -- # set +x 00:21:17.932 15:08:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:17.932 15:08:58 -- target/shutdown.sh@28 -- # cat 00:21:17.932 15:08:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:17.932 15:08:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:17.932 15:08:58 -- common/autotest_common.sh@10 -- # set +x 00:21:17.932 Malloc1 00:21:17.932 [2024-04-26 15:08:58.852902] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:17.932 Malloc2 00:21:18.194 Malloc3 00:21:18.194 Malloc4 00:21:18.194 Malloc5 00:21:18.194 Malloc6 00:21:18.194 Malloc7 00:21:18.194 Malloc8 00:21:18.456 Malloc9 00:21:18.456 Malloc10 00:21:18.456 15:08:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:18.456 15:08:59 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:18.456 15:08:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:18.456 15:08:59 -- common/autotest_common.sh@10 -- # set +x 00:21:18.456 15:08:59 -- target/shutdown.sh@125 -- # perfpid=3578617 00:21:18.456 15:08:59 -- target/shutdown.sh@126 -- # waitforlisten 3578617 /var/tmp/bdevperf.sock 00:21:18.456 15:08:59 -- common/autotest_common.sh@827 -- # '[' -z 3578617 ']' 00:21:18.456 15:08:59 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:18.456 15:08:59 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:18.456 15:08:59 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:18.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:18.456 15:08:59 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:21:18.456 15:08:59 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:18.456 15:08:59 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:18.456 15:08:59 -- common/autotest_common.sh@10 -- # set +x 00:21:18.456 15:08:59 -- nvmf/common.sh@521 -- # config=() 00:21:18.456 15:08:59 -- nvmf/common.sh@521 -- # local subsystem config 00:21:18.456 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.456 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.456 { 00:21:18.456 "params": { 00:21:18.456 "name": "Nvme$subsystem", 00:21:18.456 "trtype": "$TEST_TRANSPORT", 00:21:18.456 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.456 "adrfam": "ipv4", 00:21:18.456 "trsvcid": "$NVMF_PORT", 00:21:18.456 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.456 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.456 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 [2024-04-26 15:08:59.308907] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:18.457 [2024-04-26 15:08:59.308963] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3578617 ] 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 EAL: No free 2048 kB hugepages reported on node 1 00:21:18.457 15:08:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:18.457 { 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme$subsystem", 00:21:18.457 "trtype": "$TEST_TRANSPORT", 00:21:18.457 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "$NVMF_PORT", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:18.457 "hdgst": ${hdgst:-false}, 00:21:18.457 "ddgst": ${ddgst:-false} 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 } 00:21:18.457 EOF 00:21:18.457 )") 00:21:18.457 15:08:59 -- nvmf/common.sh@543 -- # cat 00:21:18.457 15:08:59 -- nvmf/common.sh@545 -- # jq . 00:21:18.457 15:08:59 -- nvmf/common.sh@546 -- # IFS=, 00:21:18.457 15:08:59 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme1", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme2", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme3", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme4", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme5", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme6", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme7", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme8", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme9", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 },{ 00:21:18.457 "params": { 00:21:18.457 "name": "Nvme10", 00:21:18.457 "trtype": "rdma", 00:21:18.457 "traddr": "192.168.100.8", 00:21:18.457 "adrfam": "ipv4", 00:21:18.457 "trsvcid": "4420", 00:21:18.457 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:18.457 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:18.457 "hdgst": false, 00:21:18.457 "ddgst": false 00:21:18.457 }, 00:21:18.457 "method": "bdev_nvme_attach_controller" 00:21:18.457 }' 00:21:18.457 [2024-04-26 15:08:59.369545] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:18.719 [2024-04-26 15:08:59.432443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:19.659 Running I/O for 10 seconds... 00:21:19.659 15:09:00 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:19.659 15:09:00 -- common/autotest_common.sh@860 -- # return 0 00:21:19.659 15:09:00 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:19.659 15:09:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:19.659 15:09:00 -- common/autotest_common.sh@10 -- # set +x 00:21:19.659 15:09:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:19.659 15:09:00 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:19.659 15:09:00 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:21:19.659 15:09:00 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:21:19.659 15:09:00 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:21:19.659 15:09:00 -- target/shutdown.sh@57 -- # local ret=1 00:21:19.659 15:09:00 -- target/shutdown.sh@58 -- # local i 00:21:19.659 15:09:00 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:21:19.659 15:09:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:19.659 15:09:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:19.659 15:09:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:19.659 15:09:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:19.659 15:09:00 -- common/autotest_common.sh@10 -- # set +x 00:21:19.919 15:09:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:19.919 15:09:00 -- target/shutdown.sh@60 -- # read_io_count=3 00:21:19.919 15:09:00 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:21:19.919 15:09:00 -- target/shutdown.sh@67 -- # sleep 0.25 00:21:20.202 15:09:00 -- target/shutdown.sh@59 -- # (( i-- )) 00:21:20.203 15:09:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:21:20.203 15:09:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:21:20.203 15:09:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:21:20.203 15:09:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:20.203 15:09:00 -- common/autotest_common.sh@10 -- # set +x 00:21:20.203 15:09:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:20.203 15:09:01 -- target/shutdown.sh@60 -- # read_io_count=155 00:21:20.203 15:09:01 -- target/shutdown.sh@63 -- # '[' 155 -ge 100 ']' 00:21:20.203 15:09:01 -- target/shutdown.sh@64 -- # ret=0 00:21:20.203 15:09:01 -- target/shutdown.sh@65 -- # break 00:21:20.203 15:09:01 -- target/shutdown.sh@69 -- # return 0 00:21:20.203 15:09:01 -- target/shutdown.sh@135 -- # killprocess 3578315 00:21:20.203 15:09:01 -- common/autotest_common.sh@946 -- # '[' -z 3578315 ']' 00:21:20.203 15:09:01 -- common/autotest_common.sh@950 -- # kill -0 3578315 00:21:20.203 15:09:01 -- common/autotest_common.sh@951 -- # uname 00:21:20.203 15:09:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:20.468 15:09:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3578315 00:21:20.468 15:09:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:21:20.468 15:09:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:21:20.468 15:09:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3578315' 00:21:20.468 killing process with pid 3578315 00:21:20.468 15:09:01 -- common/autotest_common.sh@965 -- # kill 3578315 00:21:20.468 15:09:01 -- common/autotest_common.sh@970 -- # wait 3578315 00:21:20.468 [2024-04-26 15:09:01.297190] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:20.729 15:09:01 -- target/shutdown.sh@136 -- # nvmfpid= 00:21:20.729 15:09:01 -- target/shutdown.sh@139 -- # sleep 1 00:21:21.678 [2024-04-26 15:09:02.276639] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927ab80 was disconnected and freed. reset controller. 00:21:21.678 [2024-04-26 15:09:02.278932] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927a940 was disconnected and freed. reset controller. 00:21:21.678 [2024-04-26 15:09:02.281110] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927a700 was disconnected and freed. reset controller. 00:21:21.678 [2024-04-26 15:09:02.283132] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927a4c0 was disconnected and freed. reset controller. 00:21:21.678 [2024-04-26 15:09:02.285027] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927a280 was disconnected and freed. reset controller. 00:21:21.678 [2024-04-26 15:09:02.285049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a05f980 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a04f900 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a03f880 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a02f800 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a01f780 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a00f700 len:0x10000 key:0x188d00 00:21:21.678 [2024-04-26 15:09:02.285154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e9f580 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e8f500 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e7f480 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e6f400 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e5f380 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e4f300 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e3f280 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e2f200 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e1f180 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019e0f100 len:0x10000 key:0x188c00 00:21:21.678 [2024-04-26 15:09:02.285353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a3f0000 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a3dff80 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a3cff00 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a3bfe80 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a3afe00 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a39fd80 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a38fd00 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a37fc80 len:0x10000 key:0x189700 00:21:21.678 [2024-04-26 15:09:02.285488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.678 [2024-04-26 15:09:02.285497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a36fc00 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a35fb80 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a34fb00 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a33fa80 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a32fa00 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a31f980 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a30f900 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2ff880 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2ef800 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2df780 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2cf700 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2bf680 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a2af600 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a29f580 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a28f500 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a27f480 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a26f400 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a25f380 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a24f300 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a23f280 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a22f200 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a21f180 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a20f100 len:0x10000 key:0x189700 00:21:21.679 [2024-04-26 15:09:02.285874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a5f0000 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a5dff80 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a5cff00 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a5bfe80 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a5afe00 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a59fd80 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.285984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a58fd00 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.285991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a57fc80 len:0x10000 key:0x188e00 00:21:21.679 [2024-04-26 15:09:02.286007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a0efe00 len:0x10000 key:0x188d00 00:21:21.679 [2024-04-26 15:09:02.286024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f5df000 len:0x10000 key:0x188900 00:21:21.679 [2024-04-26 15:09:02.286041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f5be000 len:0x10000 key:0x188900 00:21:21.679 [2024-04-26 15:09:02.286058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f59d000 len:0x10000 key:0x188900 00:21:21.679 [2024-04-26 15:09:02.286074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f57c000 len:0x10000 key:0x188900 00:21:21.679 [2024-04-26 15:09:02.286091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.679 [2024-04-26 15:09:02.286100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f55b000 len:0x10000 key:0x188900 00:21:21.679 [2024-04-26 15:09:02.286108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.286117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f53a000 len:0x10000 key:0x188900 00:21:21.680 [2024-04-26 15:09:02.286124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.286134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f519000 len:0x10000 key:0x188900 00:21:21.680 [2024-04-26 15:09:02.286141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.286152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f4f8000 len:0x10000 key:0x188900 00:21:21.680 [2024-04-26 15:09:02.286159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:408f440 sqhd:b340 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288007] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001927a040 was disconnected and freed. reset controller. 00:21:21.680 [2024-04-26 15:09:02.288024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a74fb00 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a73fa80 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a72fa00 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a71f980 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a70f900 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6ff880 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6ef800 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6df780 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6cf700 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6bf680 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6af600 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a69f580 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a68f500 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a67f480 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a66f400 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a65f380 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a64f300 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a63f280 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a62f200 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a61f180 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a60f100 len:0x10000 key:0x188f00 00:21:21.680 [2024-04-26 15:09:02.288376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9f0000 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9dff80 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9cff00 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9bfe80 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9afe00 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a99fd80 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a98fd00 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a97fc80 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a96fc00 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a95fb80 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.680 [2024-04-26 15:09:02.288553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a94fb00 len:0x10000 key:0x189400 00:21:21.680 [2024-04-26 15:09:02.288561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a93fa80 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a92fa00 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a91f980 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a90f900 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8ff880 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8ef800 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8df780 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8cf700 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8bf680 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8af600 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a89f580 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a88f500 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a87f480 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a86f400 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a85f380 len:0x10000 key:0x189400 00:21:21.681 [2024-04-26 15:09:02.288813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a46fa00 len:0x10000 key:0x188e00 00:21:21.681 [2024-04-26 15:09:02.288829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012150000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012171000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012192000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000121b3000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000121d4000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000121f5000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012216000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012237000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012258000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.288983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.288993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012279000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001229a000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000122bb000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000122dc000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000122fd000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001231e000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.289092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001233f000 len:0x10000 key:0x188900 00:21:21.681 [2024-04-26 15:09:02.289099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:ce70 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.290936] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b60eec0 was disconnected and freed. reset controller. 00:21:21.681 [2024-04-26 15:09:02.290954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aadfd80 len:0x10000 key:0x189b00 00:21:21.681 [2024-04-26 15:09:02.290962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.290974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aacfd00 len:0x10000 key:0x189b00 00:21:21.681 [2024-04-26 15:09:02.290984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.681 [2024-04-26 15:09:02.290994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aabfc80 len:0x10000 key:0x189b00 00:21:21.681 [2024-04-26 15:09:02.291002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaafc00 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa9fb80 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa8fb00 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa7fa80 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa6fa00 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa5f980 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa4f900 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa3f880 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa2f800 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa1f780 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aa0f700 len:0x10000 key:0x189b00 00:21:21.682 [2024-04-26 15:09:02.291187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a84f300 len:0x10000 key:0x189400 00:21:21.682 [2024-04-26 15:09:02.291204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a83f280 len:0x10000 key:0x189400 00:21:21.682 [2024-04-26 15:09:02.291220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a82f200 len:0x10000 key:0x189400 00:21:21.682 [2024-04-26 15:09:02.291237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a81f180 len:0x10000 key:0x189400 00:21:21.682 [2024-04-26 15:09:02.291254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a80f100 len:0x10000 key:0x189400 00:21:21.682 [2024-04-26 15:09:02.291270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adf0000 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001addff80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adcff00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adbfe80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adafe00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad9fd80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad8fd00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad7fc80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad6fc00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad5fb80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad4fb00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad3fa80 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.682 [2024-04-26 15:09:02.291485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad2fa00 len:0x10000 key:0x18a000 00:21:21.682 [2024-04-26 15:09:02.291492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad1f980 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad0f900 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acff880 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acef800 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acdf780 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001accf700 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.291604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acbf680 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.291611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acaf600 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac9f580 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac8f500 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac7f480 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac6f400 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac5f380 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac4f300 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac3f280 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac2f200 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac1f180 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac0f100 len:0x10000 key:0x18a000 00:21:21.683 [2024-04-26 15:09:02.299692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aff0000 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afdff80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afcff00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afbfe80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afafe00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af9fd80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af8fd00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af7fc80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af6fc00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af5fb80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af4fb00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af3fa80 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af2fa00 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.299908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.299918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaefe00 len:0x10000 key:0x189b00 00:21:21.683 [2024-04-26 15:09:02.299925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e600 sqhd:f730 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.301863] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b60ec80 was disconnected and freed. reset controller. 00:21:21.683 [2024-04-26 15:09:02.301902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0x189600 00:21:21.683 [2024-04-26 15:09:02.301913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.301929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1f0000 len:0x10000 key:0x189000 00:21:21.683 [2024-04-26 15:09:02.301938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.301948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1dff80 len:0x10000 key:0x189000 00:21:21.683 [2024-04-26 15:09:02.301955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.683 [2024-04-26 15:09:02.301964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1cff00 len:0x10000 key:0x189000 00:21:21.683 [2024-04-26 15:09:02.301972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.301981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1bfe80 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.301988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1afe00 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b19fd80 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b18fd00 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b17fc80 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b16fc00 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b15fb80 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b14fb00 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b13fa80 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b12fa00 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b11f980 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b10f900 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ff880 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0x189000 00:21:21.684 [2024-04-26 15:09:02.302450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x189200 00:21:21.684 [2024-04-26 15:09:02.302583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.684 [2024-04-26 15:09:02.302593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x189200 00:21:21.685 [2024-04-26 15:09:02.302966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.302976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae1f780 len:0x10000 key:0x189600 00:21:21.685 [2024-04-26 15:09:02.302983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:1ff0 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.304911] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b60ea40 was disconnected and freed. reset controller. 00:21:21.685 [2024-04-26 15:09:02.304929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:8192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001065f000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.304937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.304949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001063e000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.304956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.304966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001061d000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.304973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.304982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000105fc000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.304989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000105db000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000105ba000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010599000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010578000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010557000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010536000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010515000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000104f4000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.685 [2024-04-26 15:09:02.305136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000104d3000 len:0x10000 key:0x188900 00:21:21.685 [2024-04-26 15:09:02.305143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000104b2000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010491000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010470000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012c87000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012c66000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012c45000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012c24000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:10752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012c03000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:10880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012be2000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:11008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012bc1000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:11136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012ba0000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:11264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012f9f000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:11392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012f7e000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:11520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012f5d000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:11648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012f3c000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:11776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012f1b000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:11904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012efa000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:12032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012ed9000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:12160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012eb8000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:12288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012e97000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:12416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012e76000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:12544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012e55000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:12672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012e34000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:12800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012e13000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:12928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012df2000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:13056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012dd1000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:13184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012db0000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:13312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000131af000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:13440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001318e000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:13568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001316d000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:13696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001314c000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:13824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001312b000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:13952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001310a000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:14080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000130e9000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000130c8000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:14336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e13f000 len:0x10000 key:0x188900 00:21:21.686 [2024-04-26 15:09:02.305757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.686 [2024-04-26 15:09:02.305766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:14464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e11e000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:14592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0fd000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:14720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0dc000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:14848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0bb000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:14976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e09a000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:15104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e079000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:15232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e058000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:15360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e037000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:15488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e016000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:15616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dff5000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:15744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dfd4000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:15872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dfb3000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:16000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df92000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.305983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:16128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010788000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.305991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.306000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:16256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000107a9000 len:0x10000 key:0x188900 00:21:21.687 [2024-04-26 15:09:02.306007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:417f440 sqhd:4a00 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.308223] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b60e800 was disconnected and freed. reset controller. 00:21:21.687 [2024-04-26 15:09:02.308303] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.308314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.308323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.308330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.308338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.308345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.308353] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.308360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.310186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.687 [2024-04-26 15:09:02.310197] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:21:21.687 [2024-04-26 15:09:02.310205] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.687 [2024-04-26 15:09:02.310220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.310227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.310236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.310243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.310251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.310258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.310265] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.310272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.312028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.687 [2024-04-26 15:09:02.312038] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:21:21.687 [2024-04-26 15:09:02.312044] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.687 [2024-04-26 15:09:02.312056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.312063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.312071] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.312078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.312090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.312097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.312104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.312111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.313950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.687 [2024-04-26 15:09:02.313961] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:21:21.687 [2024-04-26 15:09:02.313967] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.687 [2024-04-26 15:09:02.313979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.313986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.687 [2024-04-26 15:09:02.313994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.687 [2024-04-26 15:09:02.314001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.314009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.314016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.314023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.314030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.315829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.315839] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:21:21.688 [2024-04-26 15:09:02.315845] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.315857] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.315864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.315872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.315879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.315886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.315893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.315901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.315907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.317635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.317667] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:21:21.688 [2024-04-26 15:09:02.317685] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.317719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.317741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.317764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.317784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.317807] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.317827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.317849] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.317869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.319721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.319751] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:21:21.688 [2024-04-26 15:09:02.319769] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.319802] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.319823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.319846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.319867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.319890] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.319910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.319932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.319953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.321478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.321489] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:21.688 [2024-04-26 15:09:02.321495] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.321506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.321514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.321524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.321531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.321538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.321545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.321553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.321559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.323326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.323336] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:21:21.688 [2024-04-26 15:09:02.323343] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.323354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.323362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.323369] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.323376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.323384] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.323390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.323398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.323404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.325094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.325123] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:21:21.688 [2024-04-26 15:09:02.325141] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.325175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.325197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.325220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.325241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.325263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.325357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.325389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:21.688 [2024-04-26 15:09:02.325410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:61469 cdw0:0 sqhd:8300 p:1 m:0 dnr:0 00:21:21.688 [2024-04-26 15:09:02.345198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:21.688 [2024-04-26 15:09:02.345211] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:21:21.688 [2024-04-26 15:09:02.345218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356782] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:21.688 [2024-04-26 15:09:02.356809] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:21:21.688 [2024-04-26 15:09:02.356820] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:21:21.688 [2024-04-26 15:09:02.356863] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356875] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356885] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356897] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356911] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356920] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.356931] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:21.688 [2024-04-26 15:09:02.357031] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:21:21.689 [2024-04-26 15:09:02.357041] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:21:21.689 [2024-04-26 15:09:02.357050] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:21:21.689 [2024-04-26 15:09:02.357061] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:21:21.689 [2024-04-26 15:09:02.359695] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:21:21.689 task offset: 35840 on job bdev=Nvme1n1 fails 00:21:21.689 00:21:21.689 Latency(us) 00:21:21.689 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:21.689 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme1n1 ended in about 2.05 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme1n1 : 2.05 124.78 7.80 31.19 0.00 407426.73 33423.36 1062557.01 00:21:21.689 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme2n1 ended in about 2.05 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme2n1 : 2.05 124.70 7.79 31.18 0.00 403728.73 35826.35 1062557.01 00:21:21.689 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme3n1 ended in about 2.05 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme3n1 : 2.05 139.73 8.73 31.16 0.00 364801.90 4123.31 1062557.01 00:21:21.689 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme4n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme4n1 : 2.06 127.49 7.97 31.14 0.00 389526.84 13926.40 1062557.01 00:21:21.689 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme5n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme5n1 : 2.06 128.39 8.02 31.12 0.00 383376.28 14308.69 1069547.52 00:21:21.689 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme6n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme6n1 : 2.06 124.43 7.78 31.11 0.00 389075.29 16930.13 1160424.11 00:21:21.689 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme7n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme7n1 : 2.06 124.36 7.77 31.09 0.00 385355.43 20316.16 1146443.09 00:21:21.689 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme8n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme8n1 : 2.06 124.29 7.77 31.07 0.00 381485.06 72526.51 1132462.08 00:21:21.689 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme9n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme9n1 : 2.06 124.22 7.76 31.06 0.00 377687.04 53302.61 1111490.56 00:21:21.689 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:21.689 Job: Nvme10n1 ended in about 2.06 seconds with error 00:21:21.689 Verification LBA range: start 0x0 length 0x400 00:21:21.689 Nvme10n1 : 2.06 31.04 1.94 31.04 0.00 933316.27 54176.43 1090519.04 00:21:21.689 =================================================================================================================== 00:21:21.689 Total : 1173.42 73.34 311.16 0.00 409618.66 4123.31 1160424.11 00:21:21.689 [2024-04-26 15:09:02.382276] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:21:21.689 [2024-04-26 15:09:02.382300] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:21:21.689 [2024-04-26 15:09:02.382312] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:21:21.689 [2024-04-26 15:09:02.400219] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.400270] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.400302] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:21:21.689 [2024-04-26 15:09:02.400642] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.400678] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.400694] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:21:21.689 [2024-04-26 15:09:02.400865] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.400887] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.400904] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:21:21.689 [2024-04-26 15:09:02.401086] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.401108] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.401132] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192a5480 00:21:21.689 [2024-04-26 15:09:02.401359] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.401386] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.401402] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b1240 00:21:21.689 [2024-04-26 15:09:02.401566] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.401587] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.401605] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:21:21.689 [2024-04-26 15:09:02.401770] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.401792] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.401808] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:21:21.689 [2024-04-26 15:09:02.402727] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.402737] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.402743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019299c00 00:21:21.689 [2024-04-26 15:09:02.402867] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.402875] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.402880] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001926e900 00:21:21.689 [2024-04-26 15:09:02.403034] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.689 [2024-04-26 15:09:02.403042] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.689 [2024-04-26 15:09:02.403047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019287200 00:21:21.689 15:09:02 -- target/shutdown.sh@142 -- # kill -9 3578617 00:21:21.689 15:09:02 -- target/shutdown.sh@144 -- # stoptarget 00:21:21.689 15:09:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:21.689 15:09:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:21.689 15:09:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:21.689 15:09:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:21.689 15:09:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:21.689 15:09:02 -- nvmf/common.sh@117 -- # sync 00:21:21.689 15:09:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:21.689 15:09:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:21.689 15:09:02 -- nvmf/common.sh@120 -- # set +e 00:21:21.689 15:09:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:21.689 15:09:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:21.689 rmmod nvme_rdma 00:21:21.689 rmmod nvme_fabrics 00:21:21.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 3578617 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:21:21.689 15:09:02 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:21.689 15:09:02 -- nvmf/common.sh@124 -- # set -e 00:21:21.689 15:09:02 -- nvmf/common.sh@125 -- # return 0 00:21:21.689 15:09:02 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:21:21.689 15:09:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:21.689 15:09:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:21.689 00:21:21.689 real 0m5.120s 00:21:21.689 user 0m17.618s 00:21:21.689 sys 0m0.983s 00:21:21.689 15:09:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:21.689 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:21:21.689 ************************************ 00:21:21.689 END TEST nvmf_shutdown_tc3 00:21:21.689 ************************************ 00:21:21.951 15:09:02 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:21:21.951 00:21:21.951 real 0m24.088s 00:21:21.951 user 1m8.159s 00:21:21.951 sys 0m8.261s 00:21:21.951 15:09:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:21.951 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:21:21.951 ************************************ 00:21:21.951 END TEST nvmf_shutdown 00:21:21.951 ************************************ 00:21:21.951 15:09:02 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:21:21.951 15:09:02 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:21.951 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:21:21.951 15:09:02 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:21:21.951 15:09:02 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:21.951 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:21:21.951 15:09:02 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:21:21.951 15:09:02 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:21:21.951 15:09:02 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:21.951 15:09:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:21.951 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:21:21.951 ************************************ 00:21:21.951 START TEST nvmf_multicontroller 00:21:21.951 ************************************ 00:21:21.951 15:09:02 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:21:22.213 * Looking for test storage... 00:21:22.213 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:22.213 15:09:02 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:22.213 15:09:02 -- nvmf/common.sh@7 -- # uname -s 00:21:22.213 15:09:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:22.213 15:09:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:22.213 15:09:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:22.213 15:09:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:22.213 15:09:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:22.213 15:09:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:22.213 15:09:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:22.213 15:09:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:22.213 15:09:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:22.213 15:09:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:22.213 15:09:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:22.213 15:09:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:22.213 15:09:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:22.213 15:09:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:22.213 15:09:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:22.213 15:09:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:22.213 15:09:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:22.213 15:09:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:22.213 15:09:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:22.213 15:09:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:22.213 15:09:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.213 15:09:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.213 15:09:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.213 15:09:03 -- paths/export.sh@5 -- # export PATH 00:21:22.213 15:09:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.213 15:09:03 -- nvmf/common.sh@47 -- # : 0 00:21:22.213 15:09:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:22.213 15:09:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:22.213 15:09:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:22.213 15:09:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:22.213 15:09:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:22.213 15:09:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:22.213 15:09:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:22.213 15:09:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:22.213 15:09:03 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:22.213 15:09:03 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:22.213 15:09:03 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:21:22.213 15:09:03 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:21:22.213 15:09:03 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:22.213 15:09:03 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:21:22.213 15:09:03 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:21:22.213 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:21:22.213 15:09:03 -- host/multicontroller.sh@20 -- # exit 0 00:21:22.213 00:21:22.213 real 0m0.133s 00:21:22.213 user 0m0.063s 00:21:22.213 sys 0m0.078s 00:21:22.213 15:09:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:22.213 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:21:22.213 ************************************ 00:21:22.213 END TEST nvmf_multicontroller 00:21:22.213 ************************************ 00:21:22.213 15:09:03 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:21:22.213 15:09:03 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:22.213 15:09:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:22.213 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:21:22.491 ************************************ 00:21:22.491 START TEST nvmf_aer 00:21:22.491 ************************************ 00:21:22.491 15:09:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:21:22.491 * Looking for test storage... 00:21:22.491 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:22.491 15:09:03 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:22.491 15:09:03 -- nvmf/common.sh@7 -- # uname -s 00:21:22.491 15:09:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:22.491 15:09:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:22.491 15:09:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:22.491 15:09:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:22.491 15:09:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:22.491 15:09:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:22.491 15:09:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:22.491 15:09:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:22.491 15:09:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:22.491 15:09:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:22.491 15:09:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:22.491 15:09:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:22.491 15:09:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:22.491 15:09:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:22.491 15:09:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:22.491 15:09:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:22.491 15:09:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:22.491 15:09:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:22.491 15:09:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:22.491 15:09:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:22.491 15:09:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.492 15:09:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.492 15:09:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.492 15:09:03 -- paths/export.sh@5 -- # export PATH 00:21:22.492 15:09:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:22.492 15:09:03 -- nvmf/common.sh@47 -- # : 0 00:21:22.492 15:09:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:22.492 15:09:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:22.492 15:09:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:22.492 15:09:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:22.492 15:09:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:22.492 15:09:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:22.492 15:09:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:22.492 15:09:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:22.492 15:09:03 -- host/aer.sh@11 -- # nvmftestinit 00:21:22.492 15:09:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:22.492 15:09:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:22.492 15:09:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:22.492 15:09:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:22.492 15:09:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:22.492 15:09:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:22.492 15:09:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:22.492 15:09:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:22.492 15:09:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:22.492 15:09:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:22.492 15:09:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:22.492 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:21:29.092 15:09:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:29.092 15:09:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:29.092 15:09:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:29.092 15:09:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:29.092 15:09:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:29.092 15:09:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:29.092 15:09:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:29.092 15:09:09 -- nvmf/common.sh@295 -- # net_devs=() 00:21:29.092 15:09:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:29.092 15:09:09 -- nvmf/common.sh@296 -- # e810=() 00:21:29.092 15:09:09 -- nvmf/common.sh@296 -- # local -ga e810 00:21:29.092 15:09:09 -- nvmf/common.sh@297 -- # x722=() 00:21:29.092 15:09:09 -- nvmf/common.sh@297 -- # local -ga x722 00:21:29.092 15:09:09 -- nvmf/common.sh@298 -- # mlx=() 00:21:29.092 15:09:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:29.092 15:09:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:29.092 15:09:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:29.092 15:09:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:29.092 15:09:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:29.092 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:29.092 15:09:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:29.092 15:09:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:29.092 15:09:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:29.092 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:29.092 15:09:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:29.092 15:09:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:29.092 15:09:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:29.092 15:09:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:29.092 15:09:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:29.092 15:09:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:29.092 15:09:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:29.092 Found net devices under 0000:31:00.0: mlx_0_0 00:21:29.092 15:09:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:29.092 15:09:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:29.092 15:09:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:29.092 15:09:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:29.092 15:09:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:29.092 Found net devices under 0000:31:00.1: mlx_0_1 00:21:29.092 15:09:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:29.092 15:09:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:29.092 15:09:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:29.092 15:09:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:29.092 15:09:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:29.092 15:09:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:29.092 15:09:09 -- nvmf/common.sh@58 -- # uname 00:21:29.092 15:09:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:29.092 15:09:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:29.092 15:09:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:29.092 15:09:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:29.092 15:09:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:29.092 15:09:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:29.092 15:09:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:29.092 15:09:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:29.092 15:09:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:29.092 15:09:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:29.092 15:09:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:29.092 15:09:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:29.092 15:09:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:29.092 15:09:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:29.092 15:09:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:29.092 15:09:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:29.092 15:09:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:29.092 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.092 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:29.092 15:09:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:29.092 15:09:10 -- nvmf/common.sh@105 -- # continue 2 00:21:29.092 15:09:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:29.092 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.092 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:29.092 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.092 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:29.092 15:09:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:29.092 15:09:10 -- nvmf/common.sh@105 -- # continue 2 00:21:29.092 15:09:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:29.092 15:09:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:29.092 15:09:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:29.092 15:09:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:29.092 15:09:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:29.092 15:09:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:29.092 15:09:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:29.092 15:09:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:29.092 15:09:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:29.092 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:29.092 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:29.092 altname enp49s0f0np0 00:21:29.092 altname ens786f0np0 00:21:29.092 inet 192.168.100.8/24 scope global mlx_0_0 00:21:29.092 valid_lft forever preferred_lft forever 00:21:29.092 15:09:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:29.355 15:09:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:29.355 15:09:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:29.355 15:09:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:29.355 15:09:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:29.355 15:09:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:29.355 15:09:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:29.355 15:09:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:29.355 15:09:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:29.355 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:29.355 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:29.355 altname enp49s0f1np1 00:21:29.355 altname ens786f1np1 00:21:29.356 inet 192.168.100.9/24 scope global mlx_0_1 00:21:29.356 valid_lft forever preferred_lft forever 00:21:29.356 15:09:10 -- nvmf/common.sh@411 -- # return 0 00:21:29.356 15:09:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:29.356 15:09:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:29.356 15:09:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:29.356 15:09:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:29.356 15:09:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:29.356 15:09:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:29.356 15:09:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:29.356 15:09:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:29.356 15:09:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:29.356 15:09:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:29.356 15:09:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:29.356 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.356 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:29.356 15:09:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:29.356 15:09:10 -- nvmf/common.sh@105 -- # continue 2 00:21:29.356 15:09:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:29.356 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.356 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:29.356 15:09:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:29.356 15:09:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:29.356 15:09:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:29.356 15:09:10 -- nvmf/common.sh@105 -- # continue 2 00:21:29.356 15:09:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:29.356 15:09:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:29.356 15:09:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:29.356 15:09:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:29.356 15:09:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:29.356 15:09:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:29.356 15:09:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:29.356 15:09:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:29.356 192.168.100.9' 00:21:29.356 15:09:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:29.356 192.168.100.9' 00:21:29.356 15:09:10 -- nvmf/common.sh@446 -- # head -n 1 00:21:29.356 15:09:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:29.356 15:09:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:29.356 192.168.100.9' 00:21:29.356 15:09:10 -- nvmf/common.sh@447 -- # tail -n +2 00:21:29.356 15:09:10 -- nvmf/common.sh@447 -- # head -n 1 00:21:29.356 15:09:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:29.356 15:09:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:29.356 15:09:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:29.356 15:09:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:29.356 15:09:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:29.356 15:09:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:29.356 15:09:10 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:21:29.356 15:09:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:29.356 15:09:10 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:29.356 15:09:10 -- common/autotest_common.sh@10 -- # set +x 00:21:29.356 15:09:10 -- nvmf/common.sh@470 -- # nvmfpid=3583545 00:21:29.356 15:09:10 -- nvmf/common.sh@471 -- # waitforlisten 3583545 00:21:29.356 15:09:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:29.356 15:09:10 -- common/autotest_common.sh@827 -- # '[' -z 3583545 ']' 00:21:29.356 15:09:10 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:29.356 15:09:10 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:29.356 15:09:10 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:29.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:29.356 15:09:10 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:29.356 15:09:10 -- common/autotest_common.sh@10 -- # set +x 00:21:29.356 [2024-04-26 15:09:10.228867] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:29.356 [2024-04-26 15:09:10.228925] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:29.356 EAL: No free 2048 kB hugepages reported on node 1 00:21:29.356 [2024-04-26 15:09:10.291712] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:29.618 [2024-04-26 15:09:10.365058] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:29.618 [2024-04-26 15:09:10.365098] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:29.618 [2024-04-26 15:09:10.365105] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:29.618 [2024-04-26 15:09:10.365112] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:29.618 [2024-04-26 15:09:10.365118] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:29.618 [2024-04-26 15:09:10.365292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:29.618 [2024-04-26 15:09:10.365428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:29.618 [2024-04-26 15:09:10.365672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:29.618 [2024-04-26 15:09:10.365677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:30.192 15:09:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:30.192 15:09:11 -- common/autotest_common.sh@860 -- # return 0 00:21:30.192 15:09:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:30.192 15:09:11 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:30.192 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.192 15:09:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:30.192 15:09:11 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:30.192 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.192 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.192 [2024-04-26 15:09:11.085294] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf65b00/0xf69ff0) succeed. 00:21:30.192 [2024-04-26 15:09:11.098705] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf67140/0xfab680) succeed. 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:21:30.453 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.453 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.453 Malloc0 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:21:30.453 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.453 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:30.453 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.453 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:30.453 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.453 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.453 [2024-04-26 15:09:11.271325] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:21:30.453 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.453 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.453 [2024-04-26 15:09:11.283007] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:21:30.453 [ 00:21:30.453 { 00:21:30.453 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:30.453 "subtype": "Discovery", 00:21:30.453 "listen_addresses": [], 00:21:30.453 "allow_any_host": true, 00:21:30.453 "hosts": [] 00:21:30.453 }, 00:21:30.453 { 00:21:30.453 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:30.453 "subtype": "NVMe", 00:21:30.453 "listen_addresses": [ 00:21:30.453 { 00:21:30.453 "transport": "RDMA", 00:21:30.453 "trtype": "RDMA", 00:21:30.453 "adrfam": "IPv4", 00:21:30.453 "traddr": "192.168.100.8", 00:21:30.453 "trsvcid": "4420" 00:21:30.453 } 00:21:30.453 ], 00:21:30.453 "allow_any_host": true, 00:21:30.453 "hosts": [], 00:21:30.453 "serial_number": "SPDK00000000000001", 00:21:30.453 "model_number": "SPDK bdev Controller", 00:21:30.453 "max_namespaces": 2, 00:21:30.453 "min_cntlid": 1, 00:21:30.453 "max_cntlid": 65519, 00:21:30.453 "namespaces": [ 00:21:30.453 { 00:21:30.453 "nsid": 1, 00:21:30.453 "bdev_name": "Malloc0", 00:21:30.453 "name": "Malloc0", 00:21:30.453 "nguid": "7E559BE6A929422195479C543C6A68A4", 00:21:30.453 "uuid": "7e559be6-a929-4221-9547-9c543c6a68a4" 00:21:30.453 } 00:21:30.453 ] 00:21:30.453 } 00:21:30.453 ] 00:21:30.453 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.453 15:09:11 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:21:30.453 15:09:11 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:21:30.453 15:09:11 -- host/aer.sh@33 -- # aerpid=3583875 00:21:30.453 15:09:11 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:21:30.453 15:09:11 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:21:30.453 15:09:11 -- common/autotest_common.sh@1261 -- # local i=0 00:21:30.453 15:09:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:30.453 15:09:11 -- common/autotest_common.sh@1263 -- # '[' 0 -lt 200 ']' 00:21:30.453 15:09:11 -- common/autotest_common.sh@1264 -- # i=1 00:21:30.453 15:09:11 -- common/autotest_common.sh@1265 -- # sleep 0.1 00:21:30.453 EAL: No free 2048 kB hugepages reported on node 1 00:21:30.715 15:09:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:30.715 15:09:11 -- common/autotest_common.sh@1263 -- # '[' 1 -lt 200 ']' 00:21:30.715 15:09:11 -- common/autotest_common.sh@1264 -- # i=2 00:21:30.715 15:09:11 -- common/autotest_common.sh@1265 -- # sleep 0.1 00:21:30.715 15:09:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:30.715 15:09:11 -- common/autotest_common.sh@1268 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:30.715 15:09:11 -- common/autotest_common.sh@1272 -- # return 0 00:21:30.715 15:09:11 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 Malloc1 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 [ 00:21:30.715 { 00:21:30.715 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:30.715 "subtype": "Discovery", 00:21:30.715 "listen_addresses": [], 00:21:30.715 "allow_any_host": true, 00:21:30.715 "hosts": [] 00:21:30.715 }, 00:21:30.715 { 00:21:30.715 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:30.715 "subtype": "NVMe", 00:21:30.715 "listen_addresses": [ 00:21:30.715 { 00:21:30.715 "transport": "RDMA", 00:21:30.715 "trtype": "RDMA", 00:21:30.715 "adrfam": "IPv4", 00:21:30.715 "traddr": "192.168.100.8", 00:21:30.715 "trsvcid": "4420" 00:21:30.715 } 00:21:30.715 ], 00:21:30.715 "allow_any_host": true, 00:21:30.715 "hosts": [], 00:21:30.715 "serial_number": "SPDK00000000000001", 00:21:30.715 "model_number": "SPDK bdev Controller", 00:21:30.715 "max_namespaces": 2, 00:21:30.715 "min_cntlid": 1, 00:21:30.715 "max_cntlid": 65519, 00:21:30.715 "namespaces": [ 00:21:30.715 { 00:21:30.715 "nsid": 1, 00:21:30.715 "bdev_name": "Malloc0", 00:21:30.715 "name": "Malloc0", 00:21:30.715 "nguid": "7E559BE6A929422195479C543C6A68A4", 00:21:30.715 "uuid": "7e559be6-a929-4221-9547-9c543c6a68a4" 00:21:30.715 }, 00:21:30.715 { 00:21:30.715 "nsid": 2, 00:21:30.715 "bdev_name": "Malloc1", 00:21:30.715 "name": "Malloc1", 00:21:30.715 "nguid": "CE171BAB8282460486E62CE48CDDB1A5", 00:21:30.715 "uuid": "ce171bab-8282-4604-86e6-2ce48cddb1a5" 00:21:30.715 } 00:21:30.715 ] 00:21:30.715 } 00:21:30.715 ] 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@43 -- # wait 3583875 00:21:30.715 Asynchronous Event Request test 00:21:30.715 Attaching to 192.168.100.8 00:21:30.715 Attached to 192.168.100.8 00:21:30.715 Registering asynchronous event callbacks... 00:21:30.715 Starting namespace attribute notice tests for all controllers... 00:21:30.715 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:21:30.715 aer_cb - Changed Namespace 00:21:30.715 Cleaning up... 00:21:30.715 15:09:11 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:30.715 15:09:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:30.715 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:30.715 15:09:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:30.715 15:09:11 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:21:30.715 15:09:11 -- host/aer.sh@51 -- # nvmftestfini 00:21:30.715 15:09:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:30.715 15:09:11 -- nvmf/common.sh@117 -- # sync 00:21:30.977 15:09:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:30.977 15:09:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:30.977 15:09:11 -- nvmf/common.sh@120 -- # set +e 00:21:30.977 15:09:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:30.977 15:09:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:30.977 rmmod nvme_rdma 00:21:30.977 rmmod nvme_fabrics 00:21:30.977 15:09:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:30.977 15:09:11 -- nvmf/common.sh@124 -- # set -e 00:21:30.977 15:09:11 -- nvmf/common.sh@125 -- # return 0 00:21:30.977 15:09:11 -- nvmf/common.sh@478 -- # '[' -n 3583545 ']' 00:21:30.977 15:09:11 -- nvmf/common.sh@479 -- # killprocess 3583545 00:21:30.977 15:09:11 -- common/autotest_common.sh@946 -- # '[' -z 3583545 ']' 00:21:30.977 15:09:11 -- common/autotest_common.sh@950 -- # kill -0 3583545 00:21:30.977 15:09:11 -- common/autotest_common.sh@951 -- # uname 00:21:30.977 15:09:11 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:30.977 15:09:11 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3583545 00:21:30.977 15:09:11 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:21:30.977 15:09:11 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:21:30.977 15:09:11 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3583545' 00:21:30.977 killing process with pid 3583545 00:21:30.977 15:09:11 -- common/autotest_common.sh@965 -- # kill 3583545 00:21:30.977 [2024-04-26 15:09:11.767157] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:21:30.977 15:09:11 -- common/autotest_common.sh@970 -- # wait 3583545 00:21:30.977 [2024-04-26 15:09:11.852955] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:31.238 15:09:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:31.238 15:09:11 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:31.238 00:21:31.238 real 0m8.783s 00:21:31.238 user 0m8.366s 00:21:31.238 sys 0m5.576s 00:21:31.238 15:09:11 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:31.238 15:09:11 -- common/autotest_common.sh@10 -- # set +x 00:21:31.238 ************************************ 00:21:31.238 END TEST nvmf_aer 00:21:31.238 ************************************ 00:21:31.238 15:09:12 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:21:31.238 15:09:12 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:31.238 15:09:12 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:31.238 15:09:12 -- common/autotest_common.sh@10 -- # set +x 00:21:31.238 ************************************ 00:21:31.238 START TEST nvmf_async_init 00:21:31.238 ************************************ 00:21:31.238 15:09:12 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:21:31.500 * Looking for test storage... 00:21:31.500 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:31.500 15:09:12 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:31.500 15:09:12 -- nvmf/common.sh@7 -- # uname -s 00:21:31.500 15:09:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:31.500 15:09:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:31.500 15:09:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:31.500 15:09:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:31.500 15:09:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:31.500 15:09:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:31.500 15:09:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:31.500 15:09:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:31.500 15:09:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:31.500 15:09:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:31.500 15:09:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:31.500 15:09:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:31.500 15:09:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:31.500 15:09:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:31.500 15:09:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:31.500 15:09:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:31.500 15:09:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:31.500 15:09:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:31.500 15:09:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:31.500 15:09:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:31.500 15:09:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.500 15:09:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.500 15:09:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.500 15:09:12 -- paths/export.sh@5 -- # export PATH 00:21:31.500 15:09:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.500 15:09:12 -- nvmf/common.sh@47 -- # : 0 00:21:31.500 15:09:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:31.500 15:09:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:31.500 15:09:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:31.500 15:09:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:31.500 15:09:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:31.500 15:09:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:31.500 15:09:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:31.500 15:09:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:31.500 15:09:12 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:21:31.500 15:09:12 -- host/async_init.sh@14 -- # null_block_size=512 00:21:31.500 15:09:12 -- host/async_init.sh@15 -- # null_bdev=null0 00:21:31.500 15:09:12 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:21:31.500 15:09:12 -- host/async_init.sh@20 -- # uuidgen 00:21:31.500 15:09:12 -- host/async_init.sh@20 -- # tr -d - 00:21:31.500 15:09:12 -- host/async_init.sh@20 -- # nguid=03b282356925449d9144ccb4ab7cee32 00:21:31.500 15:09:12 -- host/async_init.sh@22 -- # nvmftestinit 00:21:31.500 15:09:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:31.500 15:09:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:31.500 15:09:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:31.500 15:09:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:31.500 15:09:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:31.500 15:09:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:31.500 15:09:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:31.500 15:09:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:31.500 15:09:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:31.500 15:09:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:31.500 15:09:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:31.500 15:09:12 -- common/autotest_common.sh@10 -- # set +x 00:21:38.099 15:09:18 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:38.099 15:09:18 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:38.099 15:09:18 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:38.099 15:09:18 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:38.099 15:09:18 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:38.099 15:09:18 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:38.099 15:09:18 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:38.099 15:09:18 -- nvmf/common.sh@295 -- # net_devs=() 00:21:38.099 15:09:18 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:38.099 15:09:18 -- nvmf/common.sh@296 -- # e810=() 00:21:38.099 15:09:18 -- nvmf/common.sh@296 -- # local -ga e810 00:21:38.099 15:09:18 -- nvmf/common.sh@297 -- # x722=() 00:21:38.099 15:09:18 -- nvmf/common.sh@297 -- # local -ga x722 00:21:38.099 15:09:18 -- nvmf/common.sh@298 -- # mlx=() 00:21:38.099 15:09:18 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:38.099 15:09:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:38.099 15:09:18 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:38.099 15:09:18 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:38.099 15:09:18 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:38.099 15:09:18 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:38.099 15:09:18 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:38.099 15:09:18 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:38.099 15:09:18 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:38.099 15:09:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:38.099 15:09:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:38.099 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:38.099 15:09:18 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:38.099 15:09:18 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:38.099 15:09:18 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:38.099 15:09:18 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:38.099 15:09:18 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:38.099 15:09:18 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:38.099 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:38.100 15:09:18 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:38.100 15:09:18 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.100 15:09:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.100 15:09:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:38.100 Found net devices under 0000:31:00.0: mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.100 15:09:18 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.100 15:09:18 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.100 15:09:18 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:38.100 Found net devices under 0000:31:00.1: mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.100 15:09:18 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:38.100 15:09:18 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:38.100 15:09:18 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:38.100 15:09:18 -- nvmf/common.sh@58 -- # uname 00:21:38.100 15:09:18 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:38.100 15:09:18 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:38.100 15:09:18 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:38.100 15:09:18 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:38.100 15:09:18 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:38.100 15:09:18 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:38.100 15:09:18 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:38.100 15:09:18 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:38.100 15:09:18 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:38.100 15:09:18 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:38.100 15:09:18 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:38.100 15:09:18 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:38.100 15:09:18 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:38.100 15:09:18 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:38.100 15:09:18 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:38.100 15:09:18 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@105 -- # continue 2 00:21:38.100 15:09:18 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@105 -- # continue 2 00:21:38.100 15:09:18 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:38.100 15:09:18 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:38.100 15:09:18 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:38.100 15:09:18 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:38.100 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:38.100 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:38.100 altname enp49s0f0np0 00:21:38.100 altname ens786f0np0 00:21:38.100 inet 192.168.100.8/24 scope global mlx_0_0 00:21:38.100 valid_lft forever preferred_lft forever 00:21:38.100 15:09:18 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:38.100 15:09:18 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:38.100 15:09:18 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:38.100 15:09:18 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:38.100 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:38.100 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:38.100 altname enp49s0f1np1 00:21:38.100 altname ens786f1np1 00:21:38.100 inet 192.168.100.9/24 scope global mlx_0_1 00:21:38.100 valid_lft forever preferred_lft forever 00:21:38.100 15:09:18 -- nvmf/common.sh@411 -- # return 0 00:21:38.100 15:09:18 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:38.100 15:09:18 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:38.100 15:09:18 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:38.100 15:09:18 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:38.100 15:09:18 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:38.100 15:09:18 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:38.100 15:09:18 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:38.100 15:09:18 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:38.100 15:09:18 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:38.100 15:09:18 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@105 -- # continue 2 00:21:38.100 15:09:18 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:38.100 15:09:18 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:38.100 15:09:18 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@105 -- # continue 2 00:21:38.100 15:09:18 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:38.100 15:09:18 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:38.100 15:09:18 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:38.100 15:09:18 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:38.100 15:09:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:38.100 15:09:18 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:38.100 192.168.100.9' 00:21:38.100 15:09:18 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:38.100 192.168.100.9' 00:21:38.100 15:09:18 -- nvmf/common.sh@446 -- # head -n 1 00:21:38.100 15:09:18 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:38.100 15:09:18 -- nvmf/common.sh@447 -- # tail -n +2 00:21:38.100 15:09:18 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:38.100 192.168.100.9' 00:21:38.100 15:09:18 -- nvmf/common.sh@447 -- # head -n 1 00:21:38.100 15:09:18 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:38.100 15:09:18 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:38.100 15:09:18 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:38.100 15:09:18 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:38.100 15:09:18 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:38.100 15:09:18 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:38.100 15:09:18 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:21:38.100 15:09:18 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:38.100 15:09:18 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:38.100 15:09:18 -- common/autotest_common.sh@10 -- # set +x 00:21:38.100 15:09:18 -- nvmf/common.sh@470 -- # nvmfpid=3587732 00:21:38.100 15:09:18 -- nvmf/common.sh@471 -- # waitforlisten 3587732 00:21:38.100 15:09:18 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:38.100 15:09:18 -- common/autotest_common.sh@827 -- # '[' -z 3587732 ']' 00:21:38.100 15:09:18 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:38.100 15:09:18 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:38.100 15:09:18 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:38.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:38.100 15:09:18 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:38.100 15:09:18 -- common/autotest_common.sh@10 -- # set +x 00:21:38.101 [2024-04-26 15:09:19.013157] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:38.101 [2024-04-26 15:09:19.013215] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:38.101 EAL: No free 2048 kB hugepages reported on node 1 00:21:38.361 [2024-04-26 15:09:19.073888] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:38.361 [2024-04-26 15:09:19.138453] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:38.361 [2024-04-26 15:09:19.138491] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:38.361 [2024-04-26 15:09:19.138499] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:38.361 [2024-04-26 15:09:19.138505] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:38.361 [2024-04-26 15:09:19.138511] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:38.361 [2024-04-26 15:09:19.138537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:38.934 15:09:19 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:38.934 15:09:19 -- common/autotest_common.sh@860 -- # return 0 00:21:38.934 15:09:19 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:38.934 15:09:19 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:38.934 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:38.934 15:09:19 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:38.934 15:09:19 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:21:38.934 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:38.934 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:38.934 [2024-04-26 15:09:19.852852] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1453a50/0x1457f40) succeed. 00:21:38.934 [2024-04-26 15:09:19.864989] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1454f50/0x14995d0) succeed. 00:21:39.195 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.195 15:09:19 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:21:39.195 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.195 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.195 null0 00:21:39.195 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.195 15:09:19 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:21:39.195 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:19 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:21:39.196 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:19 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 03b282356925449d9144ccb4ab7cee32 00:21:39.196 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:19 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:21:39.196 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 [2024-04-26 15:09:19.942757] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:39.196 15:09:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:19 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:21:39.196 15:09:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:19 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 nvme0n1 00:21:39.196 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:20 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:39.196 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 [ 00:21:39.196 { 00:21:39.196 "name": "nvme0n1", 00:21:39.196 "aliases": [ 00:21:39.196 "03b28235-6925-449d-9144-ccb4ab7cee32" 00:21:39.196 ], 00:21:39.196 "product_name": "NVMe disk", 00:21:39.196 "block_size": 512, 00:21:39.196 "num_blocks": 2097152, 00:21:39.196 "uuid": "03b28235-6925-449d-9144-ccb4ab7cee32", 00:21:39.196 "assigned_rate_limits": { 00:21:39.196 "rw_ios_per_sec": 0, 00:21:39.196 "rw_mbytes_per_sec": 0, 00:21:39.196 "r_mbytes_per_sec": 0, 00:21:39.196 "w_mbytes_per_sec": 0 00:21:39.196 }, 00:21:39.196 "claimed": false, 00:21:39.196 "zoned": false, 00:21:39.196 "supported_io_types": { 00:21:39.196 "read": true, 00:21:39.196 "write": true, 00:21:39.196 "unmap": false, 00:21:39.196 "write_zeroes": true, 00:21:39.196 "flush": true, 00:21:39.196 "reset": true, 00:21:39.196 "compare": true, 00:21:39.196 "compare_and_write": true, 00:21:39.196 "abort": true, 00:21:39.196 "nvme_admin": true, 00:21:39.196 "nvme_io": true 00:21:39.196 }, 00:21:39.196 "memory_domains": [ 00:21:39.196 { 00:21:39.196 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:21:39.196 "dma_device_type": 0 00:21:39.196 } 00:21:39.196 ], 00:21:39.196 "driver_specific": { 00:21:39.196 "nvme": [ 00:21:39.196 { 00:21:39.196 "trid": { 00:21:39.196 "trtype": "RDMA", 00:21:39.196 "adrfam": "IPv4", 00:21:39.196 "traddr": "192.168.100.8", 00:21:39.196 "trsvcid": "4420", 00:21:39.196 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:39.196 }, 00:21:39.196 "ctrlr_data": { 00:21:39.196 "cntlid": 1, 00:21:39.196 "vendor_id": "0x8086", 00:21:39.196 "model_number": "SPDK bdev Controller", 00:21:39.196 "serial_number": "00000000000000000000", 00:21:39.196 "firmware_revision": "24.05", 00:21:39.196 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:39.196 "oacs": { 00:21:39.196 "security": 0, 00:21:39.196 "format": 0, 00:21:39.196 "firmware": 0, 00:21:39.196 "ns_manage": 0 00:21:39.196 }, 00:21:39.196 "multi_ctrlr": true, 00:21:39.196 "ana_reporting": false 00:21:39.196 }, 00:21:39.196 "vs": { 00:21:39.196 "nvme_version": "1.3" 00:21:39.196 }, 00:21:39.196 "ns_data": { 00:21:39.196 "id": 1, 00:21:39.196 "can_share": true 00:21:39.196 } 00:21:39.196 } 00:21:39.196 ], 00:21:39.196 "mp_policy": "active_passive" 00:21:39.196 } 00:21:39.196 } 00:21:39.196 ] 00:21:39.196 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:20 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:21:39.196 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 [2024-04-26 15:09:20.066187] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:21:39.196 [2024-04-26 15:09:20.095348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:39.196 [2024-04-26 15:09:20.121521] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:39.196 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:20 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:39.196 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.196 [ 00:21:39.196 { 00:21:39.196 "name": "nvme0n1", 00:21:39.196 "aliases": [ 00:21:39.196 "03b28235-6925-449d-9144-ccb4ab7cee32" 00:21:39.196 ], 00:21:39.196 "product_name": "NVMe disk", 00:21:39.196 "block_size": 512, 00:21:39.196 "num_blocks": 2097152, 00:21:39.196 "uuid": "03b28235-6925-449d-9144-ccb4ab7cee32", 00:21:39.196 "assigned_rate_limits": { 00:21:39.196 "rw_ios_per_sec": 0, 00:21:39.196 "rw_mbytes_per_sec": 0, 00:21:39.196 "r_mbytes_per_sec": 0, 00:21:39.196 "w_mbytes_per_sec": 0 00:21:39.196 }, 00:21:39.196 "claimed": false, 00:21:39.196 "zoned": false, 00:21:39.196 "supported_io_types": { 00:21:39.196 "read": true, 00:21:39.196 "write": true, 00:21:39.196 "unmap": false, 00:21:39.196 "write_zeroes": true, 00:21:39.196 "flush": true, 00:21:39.196 "reset": true, 00:21:39.196 "compare": true, 00:21:39.196 "compare_and_write": true, 00:21:39.196 "abort": true, 00:21:39.196 "nvme_admin": true, 00:21:39.196 "nvme_io": true 00:21:39.196 }, 00:21:39.196 "memory_domains": [ 00:21:39.196 { 00:21:39.196 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:21:39.196 "dma_device_type": 0 00:21:39.196 } 00:21:39.196 ], 00:21:39.196 "driver_specific": { 00:21:39.196 "nvme": [ 00:21:39.196 { 00:21:39.196 "trid": { 00:21:39.196 "trtype": "RDMA", 00:21:39.196 "adrfam": "IPv4", 00:21:39.196 "traddr": "192.168.100.8", 00:21:39.196 "trsvcid": "4420", 00:21:39.196 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:39.196 }, 00:21:39.196 "ctrlr_data": { 00:21:39.196 "cntlid": 2, 00:21:39.196 "vendor_id": "0x8086", 00:21:39.196 "model_number": "SPDK bdev Controller", 00:21:39.196 "serial_number": "00000000000000000000", 00:21:39.196 "firmware_revision": "24.05", 00:21:39.196 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:39.196 "oacs": { 00:21:39.196 "security": 0, 00:21:39.196 "format": 0, 00:21:39.196 "firmware": 0, 00:21:39.196 "ns_manage": 0 00:21:39.196 }, 00:21:39.196 "multi_ctrlr": true, 00:21:39.196 "ana_reporting": false 00:21:39.196 }, 00:21:39.196 "vs": { 00:21:39.196 "nvme_version": "1.3" 00:21:39.196 }, 00:21:39.196 "ns_data": { 00:21:39.196 "id": 1, 00:21:39.196 "can_share": true 00:21:39.196 } 00:21:39.196 } 00:21:39.196 ], 00:21:39.196 "mp_policy": "active_passive" 00:21:39.196 } 00:21:39.196 } 00:21:39.196 ] 00:21:39.196 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.196 15:09:20 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:39.196 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.196 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@53 -- # mktemp 00:21:39.458 15:09:20 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.dyd8LPvnnU 00:21:39.458 15:09:20 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:21:39.458 15:09:20 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.dyd8LPvnnU 00:21:39.458 15:09:20 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 [2024-04-26 15:09:20.197816] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.dyd8LPvnnU 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.dyd8LPvnnU 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 [2024-04-26 15:09:20.213838] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:39.458 nvme0n1 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 [ 00:21:39.458 { 00:21:39.458 "name": "nvme0n1", 00:21:39.458 "aliases": [ 00:21:39.458 "03b28235-6925-449d-9144-ccb4ab7cee32" 00:21:39.458 ], 00:21:39.458 "product_name": "NVMe disk", 00:21:39.458 "block_size": 512, 00:21:39.458 "num_blocks": 2097152, 00:21:39.458 "uuid": "03b28235-6925-449d-9144-ccb4ab7cee32", 00:21:39.458 "assigned_rate_limits": { 00:21:39.458 "rw_ios_per_sec": 0, 00:21:39.458 "rw_mbytes_per_sec": 0, 00:21:39.458 "r_mbytes_per_sec": 0, 00:21:39.458 "w_mbytes_per_sec": 0 00:21:39.458 }, 00:21:39.458 "claimed": false, 00:21:39.458 "zoned": false, 00:21:39.458 "supported_io_types": { 00:21:39.458 "read": true, 00:21:39.458 "write": true, 00:21:39.458 "unmap": false, 00:21:39.458 "write_zeroes": true, 00:21:39.458 "flush": true, 00:21:39.458 "reset": true, 00:21:39.458 "compare": true, 00:21:39.458 "compare_and_write": true, 00:21:39.458 "abort": true, 00:21:39.458 "nvme_admin": true, 00:21:39.458 "nvme_io": true 00:21:39.458 }, 00:21:39.458 "memory_domains": [ 00:21:39.458 { 00:21:39.458 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:21:39.458 "dma_device_type": 0 00:21:39.458 } 00:21:39.458 ], 00:21:39.458 "driver_specific": { 00:21:39.458 "nvme": [ 00:21:39.458 { 00:21:39.458 "trid": { 00:21:39.458 "trtype": "RDMA", 00:21:39.458 "adrfam": "IPv4", 00:21:39.458 "traddr": "192.168.100.8", 00:21:39.458 "trsvcid": "4421", 00:21:39.458 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:21:39.458 }, 00:21:39.458 "ctrlr_data": { 00:21:39.458 "cntlid": 3, 00:21:39.458 "vendor_id": "0x8086", 00:21:39.458 "model_number": "SPDK bdev Controller", 00:21:39.458 "serial_number": "00000000000000000000", 00:21:39.458 "firmware_revision": "24.05", 00:21:39.458 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:39.458 "oacs": { 00:21:39.458 "security": 0, 00:21:39.458 "format": 0, 00:21:39.458 "firmware": 0, 00:21:39.458 "ns_manage": 0 00:21:39.458 }, 00:21:39.458 "multi_ctrlr": true, 00:21:39.458 "ana_reporting": false 00:21:39.458 }, 00:21:39.458 "vs": { 00:21:39.458 "nvme_version": "1.3" 00:21:39.458 }, 00:21:39.458 "ns_data": { 00:21:39.458 "id": 1, 00:21:39.458 "can_share": true 00:21:39.458 } 00:21:39.458 } 00:21:39.458 ], 00:21:39.458 "mp_policy": "active_passive" 00:21:39.458 } 00:21:39.458 } 00:21:39.458 ] 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:39.458 15:09:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:39.458 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.458 15:09:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:39.458 15:09:20 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.dyd8LPvnnU 00:21:39.458 15:09:20 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:21:39.458 15:09:20 -- host/async_init.sh@78 -- # nvmftestfini 00:21:39.458 15:09:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:39.458 15:09:20 -- nvmf/common.sh@117 -- # sync 00:21:39.458 15:09:20 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:39.458 15:09:20 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:39.458 15:09:20 -- nvmf/common.sh@120 -- # set +e 00:21:39.458 15:09:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:39.458 15:09:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:39.458 rmmod nvme_rdma 00:21:39.458 rmmod nvme_fabrics 00:21:39.458 15:09:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:39.458 15:09:20 -- nvmf/common.sh@124 -- # set -e 00:21:39.458 15:09:20 -- nvmf/common.sh@125 -- # return 0 00:21:39.458 15:09:20 -- nvmf/common.sh@478 -- # '[' -n 3587732 ']' 00:21:39.458 15:09:20 -- nvmf/common.sh@479 -- # killprocess 3587732 00:21:39.458 15:09:20 -- common/autotest_common.sh@946 -- # '[' -z 3587732 ']' 00:21:39.458 15:09:20 -- common/autotest_common.sh@950 -- # kill -0 3587732 00:21:39.458 15:09:20 -- common/autotest_common.sh@951 -- # uname 00:21:39.458 15:09:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:39.458 15:09:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3587732 00:21:39.719 15:09:20 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:21:39.719 15:09:20 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:21:39.719 15:09:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3587732' 00:21:39.719 killing process with pid 3587732 00:21:39.719 15:09:20 -- common/autotest_common.sh@965 -- # kill 3587732 00:21:39.719 15:09:20 -- common/autotest_common.sh@970 -- # wait 3587732 00:21:39.719 [2024-04-26 15:09:20.498263] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:39.719 15:09:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:39.719 15:09:20 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:39.719 00:21:39.719 real 0m8.464s 00:21:39.719 user 0m3.722s 00:21:39.719 sys 0m5.279s 00:21:39.719 15:09:20 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:39.719 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.719 ************************************ 00:21:39.719 END TEST nvmf_async_init 00:21:39.719 ************************************ 00:21:39.719 15:09:20 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:21:39.719 15:09:20 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:39.719 15:09:20 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:39.719 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:39.980 ************************************ 00:21:39.980 START TEST dma 00:21:39.980 ************************************ 00:21:39.980 15:09:20 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:21:39.980 * Looking for test storage... 00:21:39.980 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:39.980 15:09:20 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:39.980 15:09:20 -- nvmf/common.sh@7 -- # uname -s 00:21:39.980 15:09:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:39.980 15:09:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:39.980 15:09:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:39.980 15:09:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:39.980 15:09:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:39.980 15:09:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:39.980 15:09:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:39.981 15:09:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:39.981 15:09:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:39.981 15:09:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:40.243 15:09:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:40.243 15:09:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:21:40.243 15:09:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:40.243 15:09:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:40.243 15:09:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:40.243 15:09:20 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:40.243 15:09:20 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:40.243 15:09:20 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:40.243 15:09:20 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:40.243 15:09:20 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:40.243 15:09:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.243 15:09:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.243 15:09:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.243 15:09:20 -- paths/export.sh@5 -- # export PATH 00:21:40.243 15:09:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:40.243 15:09:20 -- nvmf/common.sh@47 -- # : 0 00:21:40.243 15:09:20 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:40.243 15:09:20 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:40.243 15:09:20 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:40.243 15:09:20 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:40.243 15:09:20 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:40.243 15:09:20 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:40.243 15:09:20 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:40.243 15:09:20 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:40.243 15:09:20 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:21:40.243 15:09:20 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:21:40.243 15:09:20 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:21:40.243 15:09:20 -- host/dma.sh@18 -- # subsystem=0 00:21:40.243 15:09:20 -- host/dma.sh@93 -- # nvmftestinit 00:21:40.243 15:09:20 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:40.243 15:09:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:40.243 15:09:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:40.243 15:09:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:40.243 15:09:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:40.243 15:09:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:40.243 15:09:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:40.243 15:09:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:40.243 15:09:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:40.243 15:09:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:40.243 15:09:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:40.243 15:09:20 -- common/autotest_common.sh@10 -- # set +x 00:21:46.838 15:09:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:46.838 15:09:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:46.838 15:09:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:46.838 15:09:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:46.838 15:09:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:46.838 15:09:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:46.838 15:09:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:46.838 15:09:27 -- nvmf/common.sh@295 -- # net_devs=() 00:21:46.838 15:09:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:46.838 15:09:27 -- nvmf/common.sh@296 -- # e810=() 00:21:46.838 15:09:27 -- nvmf/common.sh@296 -- # local -ga e810 00:21:46.838 15:09:27 -- nvmf/common.sh@297 -- # x722=() 00:21:46.838 15:09:27 -- nvmf/common.sh@297 -- # local -ga x722 00:21:46.838 15:09:27 -- nvmf/common.sh@298 -- # mlx=() 00:21:46.838 15:09:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:46.838 15:09:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:46.838 15:09:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:46.838 15:09:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:46.838 15:09:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:46.838 15:09:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:46.839 15:09:27 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:46.839 15:09:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:46.839 15:09:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:46.839 15:09:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:21:46.839 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:21:46.839 15:09:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:46.839 15:09:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:46.839 15:09:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:21:46.839 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:21:46.839 15:09:27 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:46.839 15:09:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:46.839 15:09:27 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:46.839 15:09:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.839 15:09:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:46.839 15:09:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.839 15:09:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:21:46.839 Found net devices under 0000:31:00.0: mlx_0_0 00:21:46.839 15:09:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.839 15:09:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:46.839 15:09:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:46.839 15:09:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:46.839 15:09:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:46.839 15:09:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:21:46.839 Found net devices under 0000:31:00.1: mlx_0_1 00:21:46.839 15:09:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:46.839 15:09:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:46.839 15:09:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:46.839 15:09:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:46.839 15:09:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:46.839 15:09:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:46.839 15:09:27 -- nvmf/common.sh@58 -- # uname 00:21:46.839 15:09:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:46.839 15:09:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:46.839 15:09:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:46.839 15:09:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:46.839 15:09:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:46.839 15:09:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:46.839 15:09:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:46.839 15:09:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:46.839 15:09:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:46.839 15:09:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:46.839 15:09:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:46.839 15:09:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:46.839 15:09:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:46.839 15:09:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:46.839 15:09:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:47.101 15:09:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:47.101 15:09:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:47.101 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.101 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:47.101 15:09:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:47.101 15:09:27 -- nvmf/common.sh@105 -- # continue 2 00:21:47.101 15:09:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:47.101 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.101 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:47.101 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.101 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:47.101 15:09:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:47.101 15:09:27 -- nvmf/common.sh@105 -- # continue 2 00:21:47.101 15:09:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:47.101 15:09:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:47.101 15:09:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:47.101 15:09:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:47.101 15:09:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:47.101 15:09:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:47.101 15:09:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:47.101 15:09:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:47.101 15:09:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:47.101 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:47.101 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:21:47.101 altname enp49s0f0np0 00:21:47.102 altname ens786f0np0 00:21:47.102 inet 192.168.100.8/24 scope global mlx_0_0 00:21:47.102 valid_lft forever preferred_lft forever 00:21:47.102 15:09:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:47.102 15:09:27 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:47.102 15:09:27 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:47.102 15:09:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:47.102 15:09:27 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:47.102 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:47.102 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:21:47.102 altname enp49s0f1np1 00:21:47.102 altname ens786f1np1 00:21:47.102 inet 192.168.100.9/24 scope global mlx_0_1 00:21:47.102 valid_lft forever preferred_lft forever 00:21:47.102 15:09:27 -- nvmf/common.sh@411 -- # return 0 00:21:47.102 15:09:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:47.102 15:09:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:47.102 15:09:27 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:47.102 15:09:27 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:47.102 15:09:27 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:47.102 15:09:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:47.102 15:09:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:47.102 15:09:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:47.102 15:09:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:47.102 15:09:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:47.102 15:09:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:47.102 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.102 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:47.102 15:09:27 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:47.102 15:09:27 -- nvmf/common.sh@105 -- # continue 2 00:21:47.102 15:09:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:47.102 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.102 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:47.102 15:09:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:47.102 15:09:27 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:47.102 15:09:27 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@105 -- # continue 2 00:21:47.102 15:09:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:47.102 15:09:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:47.102 15:09:27 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:47.102 15:09:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:47.102 15:09:27 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:47.102 15:09:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:47.102 15:09:27 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:47.102 192.168.100.9' 00:21:47.102 15:09:27 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:47.102 192.168.100.9' 00:21:47.102 15:09:27 -- nvmf/common.sh@446 -- # head -n 1 00:21:47.102 15:09:27 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:47.102 15:09:27 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:47.102 192.168.100.9' 00:21:47.102 15:09:27 -- nvmf/common.sh@447 -- # tail -n +2 00:21:47.102 15:09:27 -- nvmf/common.sh@447 -- # head -n 1 00:21:47.102 15:09:27 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:47.102 15:09:27 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:47.102 15:09:27 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:47.102 15:09:27 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:47.102 15:09:27 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:47.102 15:09:27 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:47.102 15:09:27 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:21:47.102 15:09:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:47.102 15:09:27 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:47.102 15:09:27 -- common/autotest_common.sh@10 -- # set +x 00:21:47.102 15:09:27 -- nvmf/common.sh@470 -- # nvmfpid=3591762 00:21:47.102 15:09:27 -- nvmf/common.sh@471 -- # waitforlisten 3591762 00:21:47.102 15:09:27 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:21:47.102 15:09:27 -- common/autotest_common.sh@827 -- # '[' -z 3591762 ']' 00:21:47.102 15:09:27 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:47.102 15:09:27 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:47.102 15:09:27 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:47.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:47.102 15:09:27 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:47.102 15:09:27 -- common/autotest_common.sh@10 -- # set +x 00:21:47.102 [2024-04-26 15:09:28.009785] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:47.102 [2024-04-26 15:09:28.009849] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:47.102 EAL: No free 2048 kB hugepages reported on node 1 00:21:47.363 [2024-04-26 15:09:28.074601] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:47.363 [2024-04-26 15:09:28.149379] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:47.363 [2024-04-26 15:09:28.149416] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:47.363 [2024-04-26 15:09:28.149424] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:47.363 [2024-04-26 15:09:28.149431] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:47.363 [2024-04-26 15:09:28.149436] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:47.363 [2024-04-26 15:09:28.149638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:47.363 [2024-04-26 15:09:28.149731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:47.935 15:09:28 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:47.935 15:09:28 -- common/autotest_common.sh@860 -- # return 0 00:21:47.935 15:09:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:47.935 15:09:28 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:47.935 15:09:28 -- common/autotest_common.sh@10 -- # set +x 00:21:47.935 15:09:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:47.935 15:09:28 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:21:47.935 15:09:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:47.935 15:09:28 -- common/autotest_common.sh@10 -- # set +x 00:21:47.935 [2024-04-26 15:09:28.873409] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1892540/0x1896a30) succeed. 00:21:48.196 [2024-04-26 15:09:28.885533] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1893a40/0x18d80c0) succeed. 00:21:48.196 15:09:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.196 15:09:28 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:21:48.196 15:09:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.196 15:09:28 -- common/autotest_common.sh@10 -- # set +x 00:21:48.196 Malloc0 00:21:48.196 15:09:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.196 15:09:29 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:21:48.196 15:09:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.196 15:09:29 -- common/autotest_common.sh@10 -- # set +x 00:21:48.196 15:09:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.196 15:09:29 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:21:48.196 15:09:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.196 15:09:29 -- common/autotest_common.sh@10 -- # set +x 00:21:48.196 15:09:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.196 15:09:29 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:21:48.196 15:09:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.196 15:09:29 -- common/autotest_common.sh@10 -- # set +x 00:21:48.196 [2024-04-26 15:09:29.040996] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:48.196 15:09:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.196 15:09:29 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:21:48.196 15:09:29 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:21:48.196 15:09:29 -- nvmf/common.sh@521 -- # config=() 00:21:48.196 15:09:29 -- nvmf/common.sh@521 -- # local subsystem config 00:21:48.196 15:09:29 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:21:48.196 15:09:29 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:21:48.196 { 00:21:48.196 "params": { 00:21:48.196 "name": "Nvme$subsystem", 00:21:48.196 "trtype": "$TEST_TRANSPORT", 00:21:48.196 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:48.196 "adrfam": "ipv4", 00:21:48.196 "trsvcid": "$NVMF_PORT", 00:21:48.196 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:48.196 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:48.196 "hdgst": ${hdgst:-false}, 00:21:48.196 "ddgst": ${ddgst:-false} 00:21:48.196 }, 00:21:48.196 "method": "bdev_nvme_attach_controller" 00:21:48.196 } 00:21:48.196 EOF 00:21:48.196 )") 00:21:48.196 15:09:29 -- nvmf/common.sh@543 -- # cat 00:21:48.196 15:09:29 -- nvmf/common.sh@545 -- # jq . 00:21:48.196 15:09:29 -- nvmf/common.sh@546 -- # IFS=, 00:21:48.196 15:09:29 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:21:48.196 "params": { 00:21:48.196 "name": "Nvme0", 00:21:48.196 "trtype": "rdma", 00:21:48.196 "traddr": "192.168.100.8", 00:21:48.196 "adrfam": "ipv4", 00:21:48.196 "trsvcid": "4420", 00:21:48.196 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:48.196 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:21:48.196 "hdgst": false, 00:21:48.196 "ddgst": false 00:21:48.196 }, 00:21:48.196 "method": "bdev_nvme_attach_controller" 00:21:48.196 }' 00:21:48.196 [2024-04-26 15:09:29.089310] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:48.196 [2024-04-26 15:09:29.089359] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3591925 ] 00:21:48.196 EAL: No free 2048 kB hugepages reported on node 1 00:21:48.196 [2024-04-26 15:09:29.138555] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:48.458 [2024-04-26 15:09:29.189814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:48.458 [2024-04-26 15:09:29.189817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:53.751 bdev Nvme0n1 reports 1 memory domains 00:21:53.751 bdev Nvme0n1 supports RDMA memory domain 00:21:53.751 Initialization complete, running randrw IO for 5 sec on 2 cores 00:21:53.751 ========================================================================== 00:21:53.751 Latency [us] 00:21:53.751 IOPS MiB/s Average min max 00:21:53.751 Core 2: 24127.84 94.25 662.62 312.89 10520.02 00:21:53.751 Core 3: 21069.66 82.30 758.63 327.42 10758.87 00:21:53.751 ========================================================================== 00:21:53.751 Total : 45197.50 176.55 707.38 312.89 10758.87 00:21:53.751 00:21:53.751 Total operations: 226004, translate 226004 pull_push 0 memzero 0 00:21:53.751 15:09:34 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:21:53.751 15:09:34 -- host/dma.sh@107 -- # gen_malloc_json 00:21:53.751 15:09:34 -- host/dma.sh@21 -- # jq . 00:21:53.751 [2024-04-26 15:09:34.553399] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:53.751 [2024-04-26 15:09:34.553460] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3592947 ] 00:21:53.751 EAL: No free 2048 kB hugepages reported on node 1 00:21:53.751 [2024-04-26 15:09:34.603102] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:53.751 [2024-04-26 15:09:34.654212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:53.751 [2024-04-26 15:09:34.654215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:59.097 bdev Malloc0 reports 2 memory domains 00:21:59.097 bdev Malloc0 doesn't support RDMA memory domain 00:21:59.097 Initialization complete, running randrw IO for 5 sec on 2 cores 00:21:59.097 ========================================================================== 00:21:59.097 Latency [us] 00:21:59.097 IOPS MiB/s Average min max 00:21:59.097 Core 2: 20056.82 78.35 797.08 264.54 1005.54 00:21:59.097 Core 3: 14051.73 54.89 1137.74 318.10 1730.09 00:21:59.097 ========================================================================== 00:21:59.097 Total : 34108.54 133.24 937.43 264.54 1730.09 00:21:59.097 00:21:59.097 Total operations: 170614, translate 0 pull_push 682456 memzero 0 00:21:59.097 15:09:39 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:21:59.097 15:09:39 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:21:59.097 15:09:39 -- host/dma.sh@48 -- # local subsystem=0 00:21:59.097 15:09:39 -- host/dma.sh@50 -- # jq . 00:21:59.097 Ignoring -M option 00:21:59.097 [2024-04-26 15:09:39.902910] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:21:59.097 [2024-04-26 15:09:39.902966] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3594018 ] 00:21:59.097 EAL: No free 2048 kB hugepages reported on node 1 00:21:59.097 [2024-04-26 15:09:39.951920] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:59.097 [2024-04-26 15:09:40.003563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:59.097 [2024-04-26 15:09:40.003566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:59.358 [2024-04-26 15:09:40.195534] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:22:04.659 [2024-04-26 15:09:45.224547] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:22:04.659 bdev 9bbf6e13-d2b9-49c4-b873-afea41acc653 reports 1 memory domains 00:22:04.659 bdev 9bbf6e13-d2b9-49c4-b873-afea41acc653 supports RDMA memory domain 00:22:04.659 Initialization complete, running randread IO for 5 sec on 2 cores 00:22:04.659 ========================================================================== 00:22:04.659 Latency [us] 00:22:04.659 IOPS MiB/s Average min max 00:22:04.659 Core 2: 132933.73 519.27 119.81 51.66 2033.50 00:22:04.659 Core 3: 96852.89 378.33 164.44 58.96 2136.79 00:22:04.659 ========================================================================== 00:22:04.659 Total : 229786.63 897.60 138.62 51.66 2136.79 00:22:04.659 00:22:04.659 Total operations: 1149091, translate 0 pull_push 0 memzero 1149091 00:22:04.659 15:09:45 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:22:04.659 EAL: No free 2048 kB hugepages reported on node 1 00:22:04.659 [2024-04-26 15:09:45.478571] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:22:07.208 Initializing NVMe Controllers 00:22:07.208 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:22:07.208 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:22:07.208 Initialization complete. Launching workers. 00:22:07.208 ======================================================== 00:22:07.208 Latency(us) 00:22:07.208 Device Information : IOPS MiB/s Average min max 00:22:07.208 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7980.65 6988.92 8974.78 00:22:07.208 ======================================================== 00:22:07.208 Total : 2016.00 7.88 7980.65 6988.92 8974.78 00:22:07.208 00:22:07.208 15:09:47 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:22:07.208 15:09:47 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:22:07.208 15:09:47 -- host/dma.sh@48 -- # local subsystem=0 00:22:07.208 15:09:47 -- host/dma.sh@50 -- # jq . 00:22:07.208 [2024-04-26 15:09:47.841590] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:07.208 [2024-04-26 15:09:47.841638] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3595609 ] 00:22:07.208 EAL: No free 2048 kB hugepages reported on node 1 00:22:07.208 [2024-04-26 15:09:47.890642] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:22:07.208 [2024-04-26 15:09:47.941329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:07.208 [2024-04-26 15:09:47.941347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:07.208 [2024-04-26 15:09:48.136072] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:22:12.527 [2024-04-26 15:09:53.164585] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:22:12.527 bdev 280a1cde-9ce5-4dfc-a73c-7a3a43603e9d reports 1 memory domains 00:22:12.527 bdev 280a1cde-9ce5-4dfc-a73c-7a3a43603e9d supports RDMA memory domain 00:22:12.527 Initialization complete, running randrw IO for 5 sec on 2 cores 00:22:12.527 ========================================================================== 00:22:12.527 Latency [us] 00:22:12.527 IOPS MiB/s Average min max 00:22:12.527 Core 2: 21084.73 82.36 758.32 12.01 13321.82 00:22:12.527 Core 3: 18556.83 72.49 861.43 11.15 13113.61 00:22:12.527 ========================================================================== 00:22:12.527 Total : 39641.55 154.85 806.59 11.15 13321.82 00:22:12.527 00:22:12.527 Total operations: 198231, translate 198132 pull_push 0 memzero 99 00:22:12.527 15:09:53 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:22:12.527 15:09:53 -- host/dma.sh@120 -- # nvmftestfini 00:22:12.527 15:09:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:12.527 15:09:53 -- nvmf/common.sh@117 -- # sync 00:22:12.527 15:09:53 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:12.527 15:09:53 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:12.527 15:09:53 -- nvmf/common.sh@120 -- # set +e 00:22:12.527 15:09:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:12.527 15:09:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:12.527 rmmod nvme_rdma 00:22:12.527 rmmod nvme_fabrics 00:22:12.527 15:09:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:12.527 15:09:53 -- nvmf/common.sh@124 -- # set -e 00:22:12.527 15:09:53 -- nvmf/common.sh@125 -- # return 0 00:22:12.527 15:09:53 -- nvmf/common.sh@478 -- # '[' -n 3591762 ']' 00:22:12.527 15:09:53 -- nvmf/common.sh@479 -- # killprocess 3591762 00:22:12.527 15:09:53 -- common/autotest_common.sh@946 -- # '[' -z 3591762 ']' 00:22:12.527 15:09:53 -- common/autotest_common.sh@950 -- # kill -0 3591762 00:22:12.527 15:09:53 -- common/autotest_common.sh@951 -- # uname 00:22:12.527 15:09:53 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:22:12.527 15:09:53 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3591762 00:22:12.527 15:09:53 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:22:12.527 15:09:53 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:22:12.527 15:09:53 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3591762' 00:22:12.527 killing process with pid 3591762 00:22:12.527 15:09:53 -- common/autotest_common.sh@965 -- # kill 3591762 00:22:12.527 15:09:53 -- common/autotest_common.sh@970 -- # wait 3591762 00:22:12.527 [2024-04-26 15:09:53.468710] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:12.788 15:09:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:12.788 15:09:53 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:12.788 00:22:12.788 real 0m32.838s 00:22:12.788 user 1m35.294s 00:22:12.788 sys 0m6.123s 00:22:12.788 15:09:53 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:22:12.788 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:22:12.788 ************************************ 00:22:12.788 END TEST dma 00:22:12.788 ************************************ 00:22:12.788 15:09:53 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:22:12.788 15:09:53 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:22:12.788 15:09:53 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:22:12.788 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:22:13.050 ************************************ 00:22:13.050 START TEST nvmf_identify 00:22:13.050 ************************************ 00:22:13.050 15:09:53 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:22:13.050 * Looking for test storage... 00:22:13.050 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:13.050 15:09:53 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:13.050 15:09:53 -- nvmf/common.sh@7 -- # uname -s 00:22:13.050 15:09:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:13.050 15:09:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:13.050 15:09:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:13.050 15:09:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:13.050 15:09:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:13.050 15:09:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:13.050 15:09:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:13.050 15:09:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:13.050 15:09:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:13.050 15:09:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:13.050 15:09:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:13.050 15:09:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:13.050 15:09:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:13.050 15:09:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:13.050 15:09:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:13.050 15:09:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:13.050 15:09:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:13.050 15:09:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:13.050 15:09:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:13.050 15:09:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:13.050 15:09:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:13.050 15:09:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:13.050 15:09:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:13.050 15:09:53 -- paths/export.sh@5 -- # export PATH 00:22:13.050 15:09:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:13.050 15:09:53 -- nvmf/common.sh@47 -- # : 0 00:22:13.050 15:09:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:13.050 15:09:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:13.050 15:09:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:13.050 15:09:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:13.050 15:09:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:13.050 15:09:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:13.050 15:09:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:13.050 15:09:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:13.050 15:09:53 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:13.050 15:09:53 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:13.050 15:09:53 -- host/identify.sh@14 -- # nvmftestinit 00:22:13.050 15:09:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:13.050 15:09:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:13.050 15:09:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:13.050 15:09:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:13.050 15:09:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:13.050 15:09:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.050 15:09:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.050 15:09:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:13.050 15:09:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:13.050 15:09:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:13.050 15:09:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:13.050 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:22:19.689 15:10:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.689 15:10:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:19.689 15:10:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:19.689 15:10:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:19.689 15:10:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:19.689 15:10:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:19.689 15:10:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:19.689 15:10:00 -- nvmf/common.sh@295 -- # net_devs=() 00:22:19.689 15:10:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:19.689 15:10:00 -- nvmf/common.sh@296 -- # e810=() 00:22:19.689 15:10:00 -- nvmf/common.sh@296 -- # local -ga e810 00:22:19.689 15:10:00 -- nvmf/common.sh@297 -- # x722=() 00:22:19.689 15:10:00 -- nvmf/common.sh@297 -- # local -ga x722 00:22:19.689 15:10:00 -- nvmf/common.sh@298 -- # mlx=() 00:22:19.689 15:10:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:19.689 15:10:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.689 15:10:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:22:19.689 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:22:19.689 15:10:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:19.689 15:10:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:22:19.689 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:22:19.689 15:10:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:19.689 15:10:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.689 15:10:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.689 15:10:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:22:19.689 Found net devices under 0000:31:00.0: mlx_0_0 00:22:19.689 15:10:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.689 15:10:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.689 15:10:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:22:19.689 Found net devices under 0000:31:00.1: mlx_0_1 00:22:19.689 15:10:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.689 15:10:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:19.689 15:10:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:19.689 15:10:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:19.689 15:10:00 -- nvmf/common.sh@58 -- # uname 00:22:19.689 15:10:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:19.689 15:10:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:19.689 15:10:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:19.689 15:10:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:19.689 15:10:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:19.689 15:10:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:19.689 15:10:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:19.689 15:10:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:19.689 15:10:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:19.689 15:10:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:19.689 15:10:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:19.689 15:10:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:19.689 15:10:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:19.689 15:10:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:19.689 15:10:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:19.689 15:10:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:19.689 15:10:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:19.689 15:10:00 -- nvmf/common.sh@105 -- # continue 2 00:22:19.689 15:10:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.689 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:19.689 15:10:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:19.689 15:10:00 -- nvmf/common.sh@105 -- # continue 2 00:22:19.689 15:10:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:19.689 15:10:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:19.689 15:10:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:19.689 15:10:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:19.689 15:10:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:19.689 15:10:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:19.951 15:10:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:19.951 15:10:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:19.951 15:10:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:19.951 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:19.951 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:22:19.951 altname enp49s0f0np0 00:22:19.951 altname ens786f0np0 00:22:19.951 inet 192.168.100.8/24 scope global mlx_0_0 00:22:19.951 valid_lft forever preferred_lft forever 00:22:19.952 15:10:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:19.952 15:10:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:19.952 15:10:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:19.952 15:10:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:19.952 15:10:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:19.952 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:19.952 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:22:19.952 altname enp49s0f1np1 00:22:19.952 altname ens786f1np1 00:22:19.952 inet 192.168.100.9/24 scope global mlx_0_1 00:22:19.952 valid_lft forever preferred_lft forever 00:22:19.952 15:10:00 -- nvmf/common.sh@411 -- # return 0 00:22:19.952 15:10:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:19.952 15:10:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:19.952 15:10:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:19.952 15:10:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:19.952 15:10:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:19.952 15:10:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:19.952 15:10:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:19.952 15:10:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:19.952 15:10:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:19.952 15:10:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:19.952 15:10:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:19.952 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.952 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:19.952 15:10:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:19.952 15:10:00 -- nvmf/common.sh@105 -- # continue 2 00:22:19.952 15:10:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:19.952 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.952 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:19.952 15:10:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:19.952 15:10:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:19.952 15:10:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@105 -- # continue 2 00:22:19.952 15:10:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:19.952 15:10:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:19.952 15:10:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:19.952 15:10:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:19.952 15:10:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:19.952 15:10:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:19.952 15:10:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:19.952 192.168.100.9' 00:22:19.952 15:10:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:19.952 192.168.100.9' 00:22:19.952 15:10:00 -- nvmf/common.sh@446 -- # head -n 1 00:22:19.952 15:10:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:19.952 15:10:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:19.952 192.168.100.9' 00:22:19.952 15:10:00 -- nvmf/common.sh@447 -- # tail -n +2 00:22:19.952 15:10:00 -- nvmf/common.sh@447 -- # head -n 1 00:22:19.952 15:10:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:19.952 15:10:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:19.952 15:10:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:19.952 15:10:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:19.952 15:10:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:19.952 15:10:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:19.952 15:10:00 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:19.952 15:10:00 -- common/autotest_common.sh@720 -- # xtrace_disable 00:22:19.952 15:10:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.952 15:10:00 -- host/identify.sh@19 -- # nvmfpid=3600295 00:22:19.952 15:10:00 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:19.952 15:10:00 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:19.952 15:10:00 -- host/identify.sh@23 -- # waitforlisten 3600295 00:22:19.952 15:10:00 -- common/autotest_common.sh@827 -- # '[' -z 3600295 ']' 00:22:19.952 15:10:00 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.952 15:10:00 -- common/autotest_common.sh@832 -- # local max_retries=100 00:22:19.952 15:10:00 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.952 15:10:00 -- common/autotest_common.sh@836 -- # xtrace_disable 00:22:19.952 15:10:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.952 [2024-04-26 15:10:00.811861] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:19.952 [2024-04-26 15:10:00.811926] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.952 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.952 [2024-04-26 15:10:00.876032] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:20.213 [2024-04-26 15:10:00.950348] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:20.213 [2024-04-26 15:10:00.950386] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:20.213 [2024-04-26 15:10:00.950396] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:20.213 [2024-04-26 15:10:00.950404] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:20.213 [2024-04-26 15:10:00.950411] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:20.213 [2024-04-26 15:10:00.950540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:20.213 [2024-04-26 15:10:00.950650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:20.213 [2024-04-26 15:10:00.950781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:20.214 [2024-04-26 15:10:00.950784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:20.787 15:10:01 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:22:20.787 15:10:01 -- common/autotest_common.sh@860 -- # return 0 00:22:20.787 15:10:01 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:20.787 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:20.787 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:20.787 [2024-04-26 15:10:01.614133] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x87cb00/0x880ff0) succeed. 00:22:20.787 [2024-04-26 15:10:01.627595] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x87e140/0x8c2680) succeed. 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:21.051 15:10:01 -- common/autotest_common.sh@726 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 15:10:01 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 Malloc0 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 [2024-04-26 15:10:01.840399] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:21.051 15:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.051 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:22:21.051 [2024-04-26 15:10:01.864102] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:21.051 [ 00:22:21.051 { 00:22:21.051 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:21.051 "subtype": "Discovery", 00:22:21.051 "listen_addresses": [ 00:22:21.051 { 00:22:21.051 "transport": "RDMA", 00:22:21.051 "trtype": "RDMA", 00:22:21.051 "adrfam": "IPv4", 00:22:21.051 "traddr": "192.168.100.8", 00:22:21.051 "trsvcid": "4420" 00:22:21.051 } 00:22:21.051 ], 00:22:21.051 "allow_any_host": true, 00:22:21.051 "hosts": [] 00:22:21.051 }, 00:22:21.051 { 00:22:21.051 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.051 "subtype": "NVMe", 00:22:21.051 "listen_addresses": [ 00:22:21.051 { 00:22:21.051 "transport": "RDMA", 00:22:21.051 "trtype": "RDMA", 00:22:21.051 "adrfam": "IPv4", 00:22:21.051 "traddr": "192.168.100.8", 00:22:21.051 "trsvcid": "4420" 00:22:21.051 } 00:22:21.051 ], 00:22:21.051 "allow_any_host": true, 00:22:21.051 "hosts": [], 00:22:21.051 "serial_number": "SPDK00000000000001", 00:22:21.051 "model_number": "SPDK bdev Controller", 00:22:21.051 "max_namespaces": 32, 00:22:21.051 "min_cntlid": 1, 00:22:21.051 "max_cntlid": 65519, 00:22:21.051 "namespaces": [ 00:22:21.051 { 00:22:21.051 "nsid": 1, 00:22:21.051 "bdev_name": "Malloc0", 00:22:21.051 "name": "Malloc0", 00:22:21.051 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:21.051 "eui64": "ABCDEF0123456789", 00:22:21.051 "uuid": "310ba706-cd0f-41f6-9b13-f3135727b045" 00:22:21.051 } 00:22:21.051 ] 00:22:21.051 } 00:22:21.051 ] 00:22:21.051 15:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.051 15:10:01 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:21.051 [2024-04-26 15:10:01.902765] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:21.051 [2024-04-26 15:10:01.902811] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3600625 ] 00:22:21.051 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.051 [2024-04-26 15:10:01.959882] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:21.051 [2024-04-26 15:10:01.959967] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:22:21.051 [2024-04-26 15:10:01.959981] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:22:21.051 [2024-04-26 15:10:01.959985] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:22:21.051 [2024-04-26 15:10:01.960014] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:21.051 [2024-04-26 15:10:01.973368] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:22:21.051 [2024-04-26 15:10:01.990943] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:22:21.052 [2024-04-26 15:10:01.990952] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:22:21.052 [2024-04-26 15:10:01.990960] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990969] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990974] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990979] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990985] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990989] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990994] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.990999] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991004] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991009] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991014] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991019] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991024] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991029] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991034] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991039] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991044] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991049] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991054] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991059] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991064] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991069] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991074] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991079] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991084] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991089] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991093] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991098] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991104] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991108] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991113] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991118] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:22:21.052 [2024-04-26 15:10:01.991124] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:22:21.052 [2024-04-26 15:10:01.991127] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:22:21.052 [2024-04-26 15:10:01.991144] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.991157] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x189400 00:22:21.052 [2024-04-26 15:10:01.997283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997299] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997306] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:21.052 [2024-04-26 15:10:01.997312] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997317] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997333] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997340] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997366] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997378] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997383] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997388] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997395] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997401] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997421] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997431] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997436] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997442] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997448] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997475] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997484] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997491] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997499] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997525] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997535] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:21.052 [2024-04-26 15:10:01.997540] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997544] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997550] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997655] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:21.052 [2024-04-26 15:10:01.997660] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997668] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997674] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997694] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997704] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:21.052 [2024-04-26 15:10:01.997708] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997716] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997723] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.052 [2024-04-26 15:10:01.997746] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.052 [2024-04-26 15:10:01.997750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.052 [2024-04-26 15:10:01.997755] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:21.052 [2024-04-26 15:10:01.997759] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:21.052 [2024-04-26 15:10:01.997764] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.052 [2024-04-26 15:10:01.997770] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:21.052 [2024-04-26 15:10:01.997777] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:21.052 [2024-04-26 15:10:01.997786] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x189400 00:22:21.053 [2024-04-26 15:10:01.997838] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.997843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.997850] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:21.053 [2024-04-26 15:10:01.997855] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:21.053 [2024-04-26 15:10:01.997859] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:21.053 [2024-04-26 15:10:01.997867] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:21.053 [2024-04-26 15:10:01.997871] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:21.053 [2024-04-26 15:10:01.997876] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:21.053 [2024-04-26 15:10:01.997880] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997887] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:21.053 [2024-04-26 15:10:01.997893] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997901] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.053 [2024-04-26 15:10:01.997924] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.997929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.997937] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.053 [2024-04-26 15:10:01.997949] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.053 [2024-04-26 15:10:01.997961] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997967] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.053 [2024-04-26 15:10:01.997973] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.053 [2024-04-26 15:10:01.997983] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:21.053 [2024-04-26 15:10:01.997987] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.997997] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:21.053 [2024-04-26 15:10:01.998003] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998012] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.053 [2024-04-26 15:10:01.998033] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998043] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:21.053 [2024-04-26 15:10:01.998048] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:21.053 [2024-04-26 15:10:01.998052] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998061] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x189400 00:22:21.053 [2024-04-26 15:10:01.998097] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998108] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998116] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:21.053 [2024-04-26 15:10:01.998134] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x189400 00:22:21.053 [2024-04-26 15:10:01.998148] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.053 [2024-04-26 15:10:01.998175] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998191] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998197] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x189400 00:22:21.053 [2024-04-26 15:10:01.998202] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998207] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998217] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998241] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998254] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998261] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x189400 00:22:21.053 [2024-04-26 15:10:01.998267] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.053 [2024-04-26 15:10:01.998294] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.053 [2024-04-26 15:10:01.998299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:22:21.053 [2024-04-26 15:10:01.998308] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.053 ===================================================== 00:22:21.053 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:21.053 ===================================================== 00:22:21.053 Controller Capabilities/Features 00:22:21.053 ================================ 00:22:21.053 Vendor ID: 0000 00:22:21.053 Subsystem Vendor ID: 0000 00:22:21.053 Serial Number: .................... 00:22:21.053 Model Number: ........................................ 00:22:21.053 Firmware Version: 24.05 00:22:21.053 Recommended Arb Burst: 0 00:22:21.053 IEEE OUI Identifier: 00 00 00 00:22:21.053 Multi-path I/O 00:22:21.053 May have multiple subsystem ports: No 00:22:21.053 May have multiple controllers: No 00:22:21.053 Associated with SR-IOV VF: No 00:22:21.053 Max Data Transfer Size: 131072 00:22:21.053 Max Number of Namespaces: 0 00:22:21.053 Max Number of I/O Queues: 1024 00:22:21.053 NVMe Specification Version (VS): 1.3 00:22:21.053 NVMe Specification Version (Identify): 1.3 00:22:21.053 Maximum Queue Entries: 128 00:22:21.053 Contiguous Queues Required: Yes 00:22:21.053 Arbitration Mechanisms Supported 00:22:21.053 Weighted Round Robin: Not Supported 00:22:21.053 Vendor Specific: Not Supported 00:22:21.053 Reset Timeout: 15000 ms 00:22:21.053 Doorbell Stride: 4 bytes 00:22:21.053 NVM Subsystem Reset: Not Supported 00:22:21.053 Command Sets Supported 00:22:21.053 NVM Command Set: Supported 00:22:21.053 Boot Partition: Not Supported 00:22:21.053 Memory Page Size Minimum: 4096 bytes 00:22:21.053 Memory Page Size Maximum: 4096 bytes 00:22:21.053 Persistent Memory Region: Not Supported 00:22:21.053 Optional Asynchronous Events Supported 00:22:21.053 Namespace Attribute Notices: Not Supported 00:22:21.053 Firmware Activation Notices: Not Supported 00:22:21.053 ANA Change Notices: Not Supported 00:22:21.053 PLE Aggregate Log Change Notices: Not Supported 00:22:21.053 LBA Status Info Alert Notices: Not Supported 00:22:21.053 EGE Aggregate Log Change Notices: Not Supported 00:22:21.053 Normal NVM Subsystem Shutdown event: Not Supported 00:22:21.053 Zone Descriptor Change Notices: Not Supported 00:22:21.053 Discovery Log Change Notices: Supported 00:22:21.053 Controller Attributes 00:22:21.053 128-bit Host Identifier: Not Supported 00:22:21.053 Non-Operational Permissive Mode: Not Supported 00:22:21.053 NVM Sets: Not Supported 00:22:21.053 Read Recovery Levels: Not Supported 00:22:21.053 Endurance Groups: Not Supported 00:22:21.053 Predictable Latency Mode: Not Supported 00:22:21.053 Traffic Based Keep ALive: Not Supported 00:22:21.053 Namespace Granularity: Not Supported 00:22:21.053 SQ Associations: Not Supported 00:22:21.053 UUID List: Not Supported 00:22:21.054 Multi-Domain Subsystem: Not Supported 00:22:21.054 Fixed Capacity Management: Not Supported 00:22:21.054 Variable Capacity Management: Not Supported 00:22:21.054 Delete Endurance Group: Not Supported 00:22:21.054 Delete NVM Set: Not Supported 00:22:21.054 Extended LBA Formats Supported: Not Supported 00:22:21.054 Flexible Data Placement Supported: Not Supported 00:22:21.054 00:22:21.054 Controller Memory Buffer Support 00:22:21.054 ================================ 00:22:21.054 Supported: No 00:22:21.054 00:22:21.054 Persistent Memory Region Support 00:22:21.054 ================================ 00:22:21.054 Supported: No 00:22:21.054 00:22:21.054 Admin Command Set Attributes 00:22:21.054 ============================ 00:22:21.054 Security Send/Receive: Not Supported 00:22:21.054 Format NVM: Not Supported 00:22:21.054 Firmware Activate/Download: Not Supported 00:22:21.054 Namespace Management: Not Supported 00:22:21.054 Device Self-Test: Not Supported 00:22:21.054 Directives: Not Supported 00:22:21.054 NVMe-MI: Not Supported 00:22:21.054 Virtualization Management: Not Supported 00:22:21.054 Doorbell Buffer Config: Not Supported 00:22:21.054 Get LBA Status Capability: Not Supported 00:22:21.054 Command & Feature Lockdown Capability: Not Supported 00:22:21.054 Abort Command Limit: 1 00:22:21.054 Async Event Request Limit: 4 00:22:21.054 Number of Firmware Slots: N/A 00:22:21.323 Firmware Slot 1 Read-Only: N/A 00:22:21.323 Firmware Activation Without Reset: N/A 00:22:21.323 Multiple Update Detection Support: N/A 00:22:21.323 Firmware Update Granularity: No Information Provided 00:22:21.323 Per-Namespace SMART Log: No 00:22:21.323 Asymmetric Namespace Access Log Page: Not Supported 00:22:21.323 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:21.323 Command Effects Log Page: Not Supported 00:22:21.323 Get Log Page Extended Data: Supported 00:22:21.323 Telemetry Log Pages: Not Supported 00:22:21.323 Persistent Event Log Pages: Not Supported 00:22:21.323 Supported Log Pages Log Page: May Support 00:22:21.323 Commands Supported & Effects Log Page: Not Supported 00:22:21.323 Feature Identifiers & Effects Log Page:May Support 00:22:21.323 NVMe-MI Commands & Effects Log Page: May Support 00:22:21.323 Data Area 4 for Telemetry Log: Not Supported 00:22:21.323 Error Log Page Entries Supported: 128 00:22:21.323 Keep Alive: Not Supported 00:22:21.323 00:22:21.323 NVM Command Set Attributes 00:22:21.323 ========================== 00:22:21.323 Submission Queue Entry Size 00:22:21.323 Max: 1 00:22:21.323 Min: 1 00:22:21.323 Completion Queue Entry Size 00:22:21.323 Max: 1 00:22:21.323 Min: 1 00:22:21.323 Number of Namespaces: 0 00:22:21.323 Compare Command: Not Supported 00:22:21.323 Write Uncorrectable Command: Not Supported 00:22:21.323 Dataset Management Command: Not Supported 00:22:21.323 Write Zeroes Command: Not Supported 00:22:21.323 Set Features Save Field: Not Supported 00:22:21.323 Reservations: Not Supported 00:22:21.323 Timestamp: Not Supported 00:22:21.323 Copy: Not Supported 00:22:21.323 Volatile Write Cache: Not Present 00:22:21.323 Atomic Write Unit (Normal): 1 00:22:21.323 Atomic Write Unit (PFail): 1 00:22:21.323 Atomic Compare & Write Unit: 1 00:22:21.323 Fused Compare & Write: Supported 00:22:21.323 Scatter-Gather List 00:22:21.323 SGL Command Set: Supported 00:22:21.323 SGL Keyed: Supported 00:22:21.323 SGL Bit Bucket Descriptor: Not Supported 00:22:21.323 SGL Metadata Pointer: Not Supported 00:22:21.323 Oversized SGL: Not Supported 00:22:21.323 SGL Metadata Address: Not Supported 00:22:21.323 SGL Offset: Supported 00:22:21.323 Transport SGL Data Block: Not Supported 00:22:21.323 Replay Protected Memory Block: Not Supported 00:22:21.323 00:22:21.323 Firmware Slot Information 00:22:21.323 ========================= 00:22:21.323 Active slot: 0 00:22:21.323 00:22:21.323 00:22:21.323 Error Log 00:22:21.323 ========= 00:22:21.323 00:22:21.323 Active Namespaces 00:22:21.323 ================= 00:22:21.323 Discovery Log Page 00:22:21.323 ================== 00:22:21.323 Generation Counter: 2 00:22:21.323 Number of Records: 2 00:22:21.323 Record Format: 0 00:22:21.323 00:22:21.323 Discovery Log Entry 0 00:22:21.323 ---------------------- 00:22:21.323 Transport Type: 1 (RDMA) 00:22:21.323 Address Family: 1 (IPv4) 00:22:21.323 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:21.323 Entry Flags: 00:22:21.323 Duplicate Returned Information: 1 00:22:21.323 Explicit Persistent Connection Support for Discovery: 1 00:22:21.323 Transport Requirements: 00:22:21.323 Secure Channel: Not Required 00:22:21.323 Port ID: 0 (0x0000) 00:22:21.323 Controller ID: 65535 (0xffff) 00:22:21.323 Admin Max SQ Size: 128 00:22:21.323 Transport Service Identifier: 4420 00:22:21.323 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:21.323 Transport Address: 192.168.100.8 00:22:21.323 Transport Specific Address Subtype - RDMA 00:22:21.323 RDMA QP Service Type: 1 (Reliable Connected) 00:22:21.323 RDMA Provider Type: 1 (No provider specified) 00:22:21.323 RDMA CM Service: 1 (RDMA_CM) 00:22:21.323 Discovery Log Entry 1 00:22:21.323 ---------------------- 00:22:21.323 Transport Type: 1 (RDMA) 00:22:21.323 Address Family: 1 (IPv4) 00:22:21.323 Subsystem Type: 2 (NVM Subsystem) 00:22:21.323 Entry Flags: 00:22:21.323 Duplicate Returned Information: 0 00:22:21.323 Explicit Persistent Connection Support for Discovery: 0 00:22:21.323 Transport Requirements: 00:22:21.323 Secure Channel: Not Required 00:22:21.323 Port ID: 0 (0x0000) 00:22:21.323 Controller ID: 65535 (0xffff) 00:22:21.323 Admin Max SQ Size: [2024-04-26 15:10:01.998389] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:21.323 [2024-04-26 15:10:01.998400] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 37896 doesn't match qid 00:22:21.323 [2024-04-26 15:10:01.998415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998421] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 37896 doesn't match qid 00:22:21.324 [2024-04-26 15:10:01.998428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998433] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 37896 doesn't match qid 00:22:21.324 [2024-04-26 15:10:01.998439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998444] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 37896 doesn't match qid 00:22:21.324 [2024-04-26 15:10:01.998450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32538 cdw0:5 sqhd:9790 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998459] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998466] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998486] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998500] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998512] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998529] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998539] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:21.324 [2024-04-26 15:10:01.998544] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:21.324 [2024-04-26 15:10:01.998549] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998557] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998563] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998584] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998596] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998604] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998634] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998644] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998652] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998659] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998678] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998688] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998697] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998703] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998722] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998732] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998740] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998748] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998766] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998776] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998785] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998811] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998822] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998831] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998837] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998863] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998874] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998882] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998889] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998910] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998920] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998928] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998935] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998956] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.998960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.998965] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998974] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.998980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.998999] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.999003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.999009] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999017] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999024] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.999040] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.999045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.999050] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999058] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999065] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.999084] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.999088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.999093] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999102] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.999131] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.999136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.999141] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999149] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999156] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.999179] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.324 [2024-04-26 15:10:01.999184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:22:21.324 [2024-04-26 15:10:01.999189] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999197] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.324 [2024-04-26 15:10:01.999204] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.324 [2024-04-26 15:10:01.999223] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999232] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999241] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999248] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999274] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999289] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999297] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999327] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999336] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999345] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999351] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999368] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999378] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999386] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999393] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999417] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999427] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999435] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999442] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999460] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999470] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999479] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999504] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999513] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999522] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999545] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999555] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999563] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999596] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999606] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999614] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999621] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999641] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999651] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999659] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999686] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999696] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999704] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999711] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999731] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999741] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999750] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999756] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999775] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999785] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999793] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999800] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999819] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999828] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999837] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999843] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999866] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999876] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999884] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999913] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999923] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999931] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999939] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:01.999966] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:01.999970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:01.999976] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999984] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:01.999991] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:02.000011] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.325 [2024-04-26 15:10:02.000016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:22:21.325 [2024-04-26 15:10:02.000021] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:02.000030] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.325 [2024-04-26 15:10:02.000036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.325 [2024-04-26 15:10:02.000059] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000069] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000077] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000104] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000114] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000122] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000157] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000167] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000175] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000182] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000205] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000214] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000223] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000231] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000251] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000261] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000269] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000279] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000297] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000307] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000316] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000322] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000339] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000349] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000357] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000364] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000386] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000396] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000405] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000411] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000430] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000440] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000448] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000477] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000487] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000497] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000504] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000528] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000538] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000546] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000572] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000581] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000590] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000596] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000615] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000625] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000633] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000640] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000659] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000668] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000677] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000683] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000710] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000720] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000728] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000755] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000765] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000775] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000782] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000803] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000812] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000821] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000827] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000850] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:22:21.326 [2024-04-26 15:10:02.000860] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000868] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.326 [2024-04-26 15:10:02.000875] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.326 [2024-04-26 15:10:02.000895] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.326 [2024-04-26 15:10:02.000900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.000905] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.000913] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.000920] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.000940] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.000945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.000950] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.000959] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.000965] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.000988] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.000992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.000998] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001006] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001013] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001041] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.001046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.001053] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001061] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001068] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001088] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.001093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.001098] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001106] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001113] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001130] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.001134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.001140] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001148] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001179] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.001184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.001189] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001197] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001204] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001230] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.001235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.001240] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001248] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.001255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.001276] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.005286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.005292] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.005300] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.005307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.327 [2024-04-26 15:10:02.005324] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.327 [2024-04-26 15:10:02.005329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:000d p:0 m:0 dnr:0 00:22:21.327 [2024-04-26 15:10:02.005337] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.005344] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:22:21.327 128 00:22:21.327 Transport Service Identifier: 4420 00:22:21.327 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:21.327 Transport Address: 192.168.100.8 00:22:21.327 Transport Specific Address Subtype - RDMA 00:22:21.327 RDMA QP Service Type: 1 (Reliable Connected) 00:22:21.327 RDMA Provider Type: 1 (No provider specified) 00:22:21.327 RDMA CM Service: 1 (RDMA_CM) 00:22:21.327 15:10:02 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:21.327 [2024-04-26 15:10:02.087211] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:21.327 [2024-04-26 15:10:02.087259] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3600627 ] 00:22:21.327 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.327 [2024-04-26 15:10:02.143748] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:21.327 [2024-04-26 15:10:02.143832] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:22:21.327 [2024-04-26 15:10:02.143846] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:22:21.327 [2024-04-26 15:10:02.143850] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:22:21.327 [2024-04-26 15:10:02.143873] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:21.327 [2024-04-26 15:10:02.155851] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:22:21.327 [2024-04-26 15:10:02.177475] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:22:21.327 [2024-04-26 15:10:02.177484] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:22:21.327 [2024-04-26 15:10:02.177492] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177498] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177503] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177508] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177513] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177518] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177523] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177528] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177533] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177538] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177543] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177551] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177556] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177561] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177566] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.327 [2024-04-26 15:10:02.177571] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177576] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177581] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177586] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177591] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177596] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177601] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177606] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177611] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177616] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177621] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177626] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177631] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177636] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177641] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177646] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177650] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:22:21.328 [2024-04-26 15:10:02.177654] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:22:21.328 [2024-04-26 15:10:02.177658] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:22:21.328 [2024-04-26 15:10:02.177672] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.177684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x189400 00:22:21.328 [2024-04-26 15:10:02.184283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184297] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184303] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:21.328 [2024-04-26 15:10:02.184309] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184314] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184330] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184357] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184368] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184373] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184379] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184385] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184392] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184405] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184415] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184420] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184426] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184432] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184439] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184454] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184464] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184468] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184476] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184483] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184494] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184503] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:21.328 [2024-04-26 15:10:02.184508] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184513] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184518] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184625] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:21.328 [2024-04-26 15:10:02.184629] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184637] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184643] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184656] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184666] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:21.328 [2024-04-26 15:10:02.184670] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184678] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184685] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.328 [2024-04-26 15:10:02.184697] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184707] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:21.328 [2024-04-26 15:10:02.184711] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:21.328 [2024-04-26 15:10:02.184716] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184722] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:21.328 [2024-04-26 15:10:02.184729] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:21.328 [2024-04-26 15:10:02.184737] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.328 [2024-04-26 15:10:02.184744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x189400 00:22:21.328 [2024-04-26 15:10:02.184774] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.328 [2024-04-26 15:10:02.184779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:22:21.328 [2024-04-26 15:10:02.184786] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:21.328 [2024-04-26 15:10:02.184790] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:21.328 [2024-04-26 15:10:02.184795] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:21.328 [2024-04-26 15:10:02.184801] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:21.329 [2024-04-26 15:10:02.184805] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:21.329 [2024-04-26 15:10:02.184809] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184814] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184822] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184829] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184836] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.184851] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.184856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.184863] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184869] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.329 [2024-04-26 15:10:02.184875] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184881] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.329 [2024-04-26 15:10:02.184887] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.329 [2024-04-26 15:10:02.184899] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184905] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.329 [2024-04-26 15:10:02.184909] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184914] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184923] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184930] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184936] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.184951] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.184956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.184961] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:21.329 [2024-04-26 15:10:02.184965] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184970] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184976] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184982] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.184989] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.184995] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.185010] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185064] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185068] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185075] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185084] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x189400 00:22:21.329 [2024-04-26 15:10:02.185109] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185126] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:21.329 [2024-04-26 15:10:02.185134] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185139] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185146] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185153] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x189400 00:22:21.329 [2024-04-26 15:10:02.185184] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185200] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185205] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185211] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185219] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x189400 00:22:21.329 [2024-04-26 15:10:02.185244] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185256] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185261] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185267] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185280] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185286] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185291] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185296] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:21.329 [2024-04-26 15:10:02.185301] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:21.329 [2024-04-26 15:10:02.185305] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:21.329 [2024-04-26 15:10:02.185318] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185324] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.185331] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:21.329 [2024-04-26 15:10:02.185346] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185356] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185361] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185370] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185378] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185385] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.185398] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185408] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185416] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185422] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.329 [2024-04-26 15:10:02.185436] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.329 [2024-04-26 15:10:02.185440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:22:21.329 [2024-04-26 15:10:02.185445] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185453] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.329 [2024-04-26 15:10:02.185459] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.330 [2024-04-26 15:10:02.185474] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.330 [2024-04-26 15:10:02.185479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:22:21.330 [2024-04-26 15:10:02.185484] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185494] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185501] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x189400 00:22:21.330 [2024-04-26 15:10:02.185509] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185515] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x189400 00:22:21.330 [2024-04-26 15:10:02.185523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x189400 00:22:21.330 [2024-04-26 15:10:02.185537] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185544] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x189400 00:22:21.330 [2024-04-26 15:10:02.185551] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.330 [2024-04-26 15:10:02.185556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:22:21.330 [2024-04-26 15:10:02.185568] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185573] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.330 [2024-04-26 15:10:02.185578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:22:21.330 [2024-04-26 15:10:02.185585] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185591] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.330 [2024-04-26 15:10:02.185595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:22:21.330 [2024-04-26 15:10:02.185601] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.330 [2024-04-26 15:10:02.185606] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.330 [2024-04-26 15:10:02.185610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:22:21.330 [2024-04-26 15:10:02.185619] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.330 ===================================================== 00:22:21.330 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:21.330 ===================================================== 00:22:21.330 Controller Capabilities/Features 00:22:21.330 ================================ 00:22:21.330 Vendor ID: 8086 00:22:21.330 Subsystem Vendor ID: 8086 00:22:21.330 Serial Number: SPDK00000000000001 00:22:21.330 Model Number: SPDK bdev Controller 00:22:21.330 Firmware Version: 24.05 00:22:21.330 Recommended Arb Burst: 6 00:22:21.330 IEEE OUI Identifier: e4 d2 5c 00:22:21.330 Multi-path I/O 00:22:21.330 May have multiple subsystem ports: Yes 00:22:21.330 May have multiple controllers: Yes 00:22:21.330 Associated with SR-IOV VF: No 00:22:21.330 Max Data Transfer Size: 131072 00:22:21.330 Max Number of Namespaces: 32 00:22:21.330 Max Number of I/O Queues: 127 00:22:21.330 NVMe Specification Version (VS): 1.3 00:22:21.330 NVMe Specification Version (Identify): 1.3 00:22:21.330 Maximum Queue Entries: 128 00:22:21.330 Contiguous Queues Required: Yes 00:22:21.330 Arbitration Mechanisms Supported 00:22:21.330 Weighted Round Robin: Not Supported 00:22:21.330 Vendor Specific: Not Supported 00:22:21.330 Reset Timeout: 15000 ms 00:22:21.330 Doorbell Stride: 4 bytes 00:22:21.330 NVM Subsystem Reset: Not Supported 00:22:21.330 Command Sets Supported 00:22:21.330 NVM Command Set: Supported 00:22:21.330 Boot Partition: Not Supported 00:22:21.330 Memory Page Size Minimum: 4096 bytes 00:22:21.330 Memory Page Size Maximum: 4096 bytes 00:22:21.330 Persistent Memory Region: Not Supported 00:22:21.330 Optional Asynchronous Events Supported 00:22:21.330 Namespace Attribute Notices: Supported 00:22:21.330 Firmware Activation Notices: Not Supported 00:22:21.330 ANA Change Notices: Not Supported 00:22:21.330 PLE Aggregate Log Change Notices: Not Supported 00:22:21.330 LBA Status Info Alert Notices: Not Supported 00:22:21.330 EGE Aggregate Log Change Notices: Not Supported 00:22:21.330 Normal NVM Subsystem Shutdown event: Not Supported 00:22:21.330 Zone Descriptor Change Notices: Not Supported 00:22:21.330 Discovery Log Change Notices: Not Supported 00:22:21.330 Controller Attributes 00:22:21.330 128-bit Host Identifier: Supported 00:22:21.330 Non-Operational Permissive Mode: Not Supported 00:22:21.330 NVM Sets: Not Supported 00:22:21.330 Read Recovery Levels: Not Supported 00:22:21.330 Endurance Groups: Not Supported 00:22:21.330 Predictable Latency Mode: Not Supported 00:22:21.330 Traffic Based Keep ALive: Not Supported 00:22:21.330 Namespace Granularity: Not Supported 00:22:21.330 SQ Associations: Not Supported 00:22:21.330 UUID List: Not Supported 00:22:21.330 Multi-Domain Subsystem: Not Supported 00:22:21.330 Fixed Capacity Management: Not Supported 00:22:21.330 Variable Capacity Management: Not Supported 00:22:21.330 Delete Endurance Group: Not Supported 00:22:21.330 Delete NVM Set: Not Supported 00:22:21.330 Extended LBA Formats Supported: Not Supported 00:22:21.330 Flexible Data Placement Supported: Not Supported 00:22:21.330 00:22:21.330 Controller Memory Buffer Support 00:22:21.330 ================================ 00:22:21.330 Supported: No 00:22:21.330 00:22:21.330 Persistent Memory Region Support 00:22:21.330 ================================ 00:22:21.330 Supported: No 00:22:21.330 00:22:21.330 Admin Command Set Attributes 00:22:21.330 ============================ 00:22:21.330 Security Send/Receive: Not Supported 00:22:21.330 Format NVM: Not Supported 00:22:21.330 Firmware Activate/Download: Not Supported 00:22:21.330 Namespace Management: Not Supported 00:22:21.330 Device Self-Test: Not Supported 00:22:21.330 Directives: Not Supported 00:22:21.330 NVMe-MI: Not Supported 00:22:21.330 Virtualization Management: Not Supported 00:22:21.330 Doorbell Buffer Config: Not Supported 00:22:21.330 Get LBA Status Capability: Not Supported 00:22:21.330 Command & Feature Lockdown Capability: Not Supported 00:22:21.330 Abort Command Limit: 4 00:22:21.330 Async Event Request Limit: 4 00:22:21.330 Number of Firmware Slots: N/A 00:22:21.330 Firmware Slot 1 Read-Only: N/A 00:22:21.330 Firmware Activation Without Reset: N/A 00:22:21.330 Multiple Update Detection Support: N/A 00:22:21.330 Firmware Update Granularity: No Information Provided 00:22:21.330 Per-Namespace SMART Log: No 00:22:21.330 Asymmetric Namespace Access Log Page: Not Supported 00:22:21.330 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:21.330 Command Effects Log Page: Supported 00:22:21.330 Get Log Page Extended Data: Supported 00:22:21.330 Telemetry Log Pages: Not Supported 00:22:21.330 Persistent Event Log Pages: Not Supported 00:22:21.330 Supported Log Pages Log Page: May Support 00:22:21.330 Commands Supported & Effects Log Page: Not Supported 00:22:21.330 Feature Identifiers & Effects Log Page:May Support 00:22:21.330 NVMe-MI Commands & Effects Log Page: May Support 00:22:21.330 Data Area 4 for Telemetry Log: Not Supported 00:22:21.330 Error Log Page Entries Supported: 128 00:22:21.330 Keep Alive: Supported 00:22:21.330 Keep Alive Granularity: 10000 ms 00:22:21.330 00:22:21.330 NVM Command Set Attributes 00:22:21.330 ========================== 00:22:21.330 Submission Queue Entry Size 00:22:21.330 Max: 64 00:22:21.330 Min: 64 00:22:21.330 Completion Queue Entry Size 00:22:21.330 Max: 16 00:22:21.330 Min: 16 00:22:21.330 Number of Namespaces: 32 00:22:21.330 Compare Command: Supported 00:22:21.330 Write Uncorrectable Command: Not Supported 00:22:21.330 Dataset Management Command: Supported 00:22:21.330 Write Zeroes Command: Supported 00:22:21.330 Set Features Save Field: Not Supported 00:22:21.330 Reservations: Supported 00:22:21.330 Timestamp: Not Supported 00:22:21.330 Copy: Supported 00:22:21.330 Volatile Write Cache: Present 00:22:21.330 Atomic Write Unit (Normal): 1 00:22:21.330 Atomic Write Unit (PFail): 1 00:22:21.330 Atomic Compare & Write Unit: 1 00:22:21.330 Fused Compare & Write: Supported 00:22:21.330 Scatter-Gather List 00:22:21.330 SGL Command Set: Supported 00:22:21.330 SGL Keyed: Supported 00:22:21.330 SGL Bit Bucket Descriptor: Not Supported 00:22:21.330 SGL Metadata Pointer: Not Supported 00:22:21.330 Oversized SGL: Not Supported 00:22:21.330 SGL Metadata Address: Not Supported 00:22:21.330 SGL Offset: Supported 00:22:21.330 Transport SGL Data Block: Not Supported 00:22:21.330 Replay Protected Memory Block: Not Supported 00:22:21.330 00:22:21.330 Firmware Slot Information 00:22:21.330 ========================= 00:22:21.330 Active slot: 1 00:22:21.330 Slot 1 Firmware Revision: 24.05 00:22:21.330 00:22:21.330 00:22:21.331 Commands Supported and Effects 00:22:21.331 ============================== 00:22:21.331 Admin Commands 00:22:21.331 -------------- 00:22:21.331 Get Log Page (02h): Supported 00:22:21.331 Identify (06h): Supported 00:22:21.331 Abort (08h): Supported 00:22:21.331 Set Features (09h): Supported 00:22:21.331 Get Features (0Ah): Supported 00:22:21.331 Asynchronous Event Request (0Ch): Supported 00:22:21.331 Keep Alive (18h): Supported 00:22:21.331 I/O Commands 00:22:21.331 ------------ 00:22:21.331 Flush (00h): Supported LBA-Change 00:22:21.331 Write (01h): Supported LBA-Change 00:22:21.331 Read (02h): Supported 00:22:21.331 Compare (05h): Supported 00:22:21.331 Write Zeroes (08h): Supported LBA-Change 00:22:21.331 Dataset Management (09h): Supported LBA-Change 00:22:21.331 Copy (19h): Supported LBA-Change 00:22:21.331 Unknown (79h): Supported LBA-Change 00:22:21.331 Unknown (7Ah): Supported 00:22:21.331 00:22:21.331 Error Log 00:22:21.331 ========= 00:22:21.331 00:22:21.331 Arbitration 00:22:21.331 =========== 00:22:21.331 Arbitration Burst: 1 00:22:21.331 00:22:21.331 Power Management 00:22:21.331 ================ 00:22:21.331 Number of Power States: 1 00:22:21.331 Current Power State: Power State #0 00:22:21.331 Power State #0: 00:22:21.331 Max Power: 0.00 W 00:22:21.331 Non-Operational State: Operational 00:22:21.331 Entry Latency: Not Reported 00:22:21.331 Exit Latency: Not Reported 00:22:21.331 Relative Read Throughput: 0 00:22:21.331 Relative Read Latency: 0 00:22:21.331 Relative Write Throughput: 0 00:22:21.331 Relative Write Latency: 0 00:22:21.331 Idle Power: Not Reported 00:22:21.331 Active Power: Not Reported 00:22:21.331 Non-Operational Permissive Mode: Not Supported 00:22:21.331 00:22:21.331 Health Information 00:22:21.331 ================== 00:22:21.331 Critical Warnings: 00:22:21.331 Available Spare Space: OK 00:22:21.331 Temperature: OK 00:22:21.331 Device Reliability: OK 00:22:21.331 Read Only: No 00:22:21.331 Volatile Memory Backup: OK 00:22:21.331 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:21.331 Temperature Threshold: [2024-04-26 15:10:02.185713] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185721] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.185740] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.185745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185751] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185775] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:21.331 [2024-04-26 15:10:02.185783] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 43780 doesn't match qid 00:22:21.331 [2024-04-26 15:10:02.185796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32576 cdw0:5 sqhd:1790 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185801] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 43780 doesn't match qid 00:22:21.331 [2024-04-26 15:10:02.185808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32576 cdw0:5 sqhd:1790 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185813] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 43780 doesn't match qid 00:22:21.331 [2024-04-26 15:10:02.185819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32576 cdw0:5 sqhd:1790 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185824] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 43780 doesn't match qid 00:22:21.331 [2024-04-26 15:10:02.185830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32576 cdw0:5 sqhd:1790 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185839] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185846] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.185861] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.185866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185873] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185880] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.185885] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185896] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.185901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185906] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:21.331 [2024-04-26 15:10:02.185910] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:21.331 [2024-04-26 15:10:02.185915] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185923] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.185944] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.185949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185955] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185963] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.185970] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.185987] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.185993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.185999] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186015] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186028] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186038] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186047] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186068] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186078] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186087] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186094] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186105] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186115] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186123] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186131] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186144] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186154] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186163] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186171] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186186] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186196] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186204] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.331 [2024-04-26 15:10:02.186227] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.331 [2024-04-26 15:10:02.186232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:22:21.331 [2024-04-26 15:10:02.186237] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.331 [2024-04-26 15:10:02.186246] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186253] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186270] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186285] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186294] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186301] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186317] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186327] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186336] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186357] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186367] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186375] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186399] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186409] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186417] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186424] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186436] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186446] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186455] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186462] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186473] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186483] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186492] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186499] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186513] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186523] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186531] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186538] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186555] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186565] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186573] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186595] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186604] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186613] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186620] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186634] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186644] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186653] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186660] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186672] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186682] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186690] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186713] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186723] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186731] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186738] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186753] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186762] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186771] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186778] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186792] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186802] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186810] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186830] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.332 [2024-04-26 15:10:02.186834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:22:21.332 [2024-04-26 15:10:02.186840] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186848] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.332 [2024-04-26 15:10:02.186855] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.332 [2024-04-26 15:10:02.186869] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.186874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.186879] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186887] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186894] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.186907] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.186911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.186917] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186925] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186933] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.186948] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.186953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.186958] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186966] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.186973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.186986] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.186990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.186995] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187004] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187023] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187033] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187041] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187048] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187063] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187072] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187081] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187088] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187102] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187112] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187120] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187127] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187144] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187153] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187163] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187170] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187185] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187195] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187203] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187225] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187234] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187243] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187250] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187266] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187280] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187289] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187296] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187309] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187318] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187327] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187333] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187348] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187358] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187366] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187373] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187388] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187398] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187407] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187414] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187429] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187439] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187447] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187454] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187469] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187478] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187487] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187494] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187508] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187518] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187526] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187533] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187550] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:22:21.333 [2024-04-26 15:10:02.187560] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187568] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.333 [2024-04-26 15:10:02.187575] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.333 [2024-04-26 15:10:02.187589] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.333 [2024-04-26 15:10:02.187594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187599] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187608] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187615] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187627] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187639] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187647] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187654] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187669] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187678] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187687] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187694] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187710] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187720] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187728] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187750] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187760] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187768] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187775] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187790] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187799] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187808] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187815] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187833] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187843] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187851] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187858] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187871] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187882] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187890] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187897] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187912] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187922] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187930] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187952] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187962] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187970] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.187977] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.187990] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.187994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.187999] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188015] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188027] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188037] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188046] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188065] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188075] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188083] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188090] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188107] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188118] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188126] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188133] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188148] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188158] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188166] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188186] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188195] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188204] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188225] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188235] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188243] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.188250] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.188265] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.188269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:22:21.334 [2024-04-26 15:10:02.188275] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.192289] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x189400 00:22:21.334 [2024-04-26 15:10:02.192297] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:22:21.334 [2024-04-26 15:10:02.192314] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:22:21.334 [2024-04-26 15:10:02.192318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0016 p:0 m:0 dnr:0 00:22:21.335 [2024-04-26 15:10:02.192324] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x189400 00:22:21.335 [2024-04-26 15:10:02.192330] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:22:21.335 0 Kelvin (-273 Celsius) 00:22:21.335 Available Spare: 0% 00:22:21.335 Available Spare Threshold: 0% 00:22:21.335 Life Percentage Used: 0% 00:22:21.335 Data Units Read: 0 00:22:21.335 Data Units Written: 0 00:22:21.335 Host Read Commands: 0 00:22:21.335 Host Write Commands: 0 00:22:21.335 Controller Busy Time: 0 minutes 00:22:21.335 Power Cycles: 0 00:22:21.335 Power On Hours: 0 hours 00:22:21.335 Unsafe Shutdowns: 0 00:22:21.335 Unrecoverable Media Errors: 0 00:22:21.335 Lifetime Error Log Entries: 0 00:22:21.335 Warning Temperature Time: 0 minutes 00:22:21.335 Critical Temperature Time: 0 minutes 00:22:21.335 00:22:21.335 Number of Queues 00:22:21.335 ================ 00:22:21.335 Number of I/O Submission Queues: 127 00:22:21.335 Number of I/O Completion Queues: 127 00:22:21.335 00:22:21.335 Active Namespaces 00:22:21.335 ================= 00:22:21.335 Namespace ID:1 00:22:21.335 Error Recovery Timeout: Unlimited 00:22:21.335 Command Set Identifier: NVM (00h) 00:22:21.335 Deallocate: Supported 00:22:21.335 Deallocated/Unwritten Error: Not Supported 00:22:21.335 Deallocated Read Value: Unknown 00:22:21.335 Deallocate in Write Zeroes: Not Supported 00:22:21.335 Deallocated Guard Field: 0xFFFF 00:22:21.335 Flush: Supported 00:22:21.335 Reservation: Supported 00:22:21.335 Namespace Sharing Capabilities: Multiple Controllers 00:22:21.335 Size (in LBAs): 131072 (0GiB) 00:22:21.335 Capacity (in LBAs): 131072 (0GiB) 00:22:21.335 Utilization (in LBAs): 131072 (0GiB) 00:22:21.335 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:21.335 EUI64: ABCDEF0123456789 00:22:21.335 UUID: 310ba706-cd0f-41f6-9b13-f3135727b045 00:22:21.335 Thin Provisioning: Not Supported 00:22:21.335 Per-NS Atomic Units: Yes 00:22:21.335 Atomic Boundary Size (Normal): 0 00:22:21.335 Atomic Boundary Size (PFail): 0 00:22:21.335 Atomic Boundary Offset: 0 00:22:21.335 Maximum Single Source Range Length: 65535 00:22:21.335 Maximum Copy Length: 65535 00:22:21.335 Maximum Source Range Count: 1 00:22:21.335 NGUID/EUI64 Never Reused: No 00:22:21.335 Namespace Write Protected: No 00:22:21.335 Number of LBA Formats: 1 00:22:21.335 Current LBA Format: LBA Format #00 00:22:21.335 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:21.335 00:22:21.335 15:10:02 -- host/identify.sh@51 -- # sync 00:22:21.335 15:10:02 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:21.335 15:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:21.335 15:10:02 -- common/autotest_common.sh@10 -- # set +x 00:22:21.335 15:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:21.335 15:10:02 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:21.335 15:10:02 -- host/identify.sh@56 -- # nvmftestfini 00:22:21.335 15:10:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:21.335 15:10:02 -- nvmf/common.sh@117 -- # sync 00:22:21.597 15:10:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:21.597 15:10:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:21.597 15:10:02 -- nvmf/common.sh@120 -- # set +e 00:22:21.597 15:10:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:21.597 15:10:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:21.597 rmmod nvme_rdma 00:22:21.597 rmmod nvme_fabrics 00:22:21.597 15:10:02 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:21.597 15:10:02 -- nvmf/common.sh@124 -- # set -e 00:22:21.597 15:10:02 -- nvmf/common.sh@125 -- # return 0 00:22:21.597 15:10:02 -- nvmf/common.sh@478 -- # '[' -n 3600295 ']' 00:22:21.597 15:10:02 -- nvmf/common.sh@479 -- # killprocess 3600295 00:22:21.597 15:10:02 -- common/autotest_common.sh@946 -- # '[' -z 3600295 ']' 00:22:21.597 15:10:02 -- common/autotest_common.sh@950 -- # kill -0 3600295 00:22:21.597 15:10:02 -- common/autotest_common.sh@951 -- # uname 00:22:21.597 15:10:02 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:22:21.597 15:10:02 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3600295 00:22:21.597 15:10:02 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:22:21.597 15:10:02 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:22:21.597 15:10:02 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3600295' 00:22:21.597 killing process with pid 3600295 00:22:21.597 15:10:02 -- common/autotest_common.sh@965 -- # kill 3600295 00:22:21.597 [2024-04-26 15:10:02.363195] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:21.597 15:10:02 -- common/autotest_common.sh@970 -- # wait 3600295 00:22:21.597 [2024-04-26 15:10:02.443776] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:21.860 15:10:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:21.860 15:10:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:21.860 00:22:21.860 real 0m8.748s 00:22:21.860 user 0m8.539s 00:22:21.860 sys 0m5.398s 00:22:21.860 15:10:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:22:21.860 15:10:02 -- common/autotest_common.sh@10 -- # set +x 00:22:21.860 ************************************ 00:22:21.860 END TEST nvmf_identify 00:22:21.860 ************************************ 00:22:21.860 15:10:02 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:22:21.860 15:10:02 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:22:21.860 15:10:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:22:21.860 15:10:02 -- common/autotest_common.sh@10 -- # set +x 00:22:21.860 ************************************ 00:22:21.860 START TEST nvmf_perf 00:22:21.860 ************************************ 00:22:21.860 15:10:02 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:22:22.122 * Looking for test storage... 00:22:22.122 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:22.122 15:10:02 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:22.122 15:10:02 -- nvmf/common.sh@7 -- # uname -s 00:22:22.122 15:10:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:22.122 15:10:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:22.122 15:10:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:22.122 15:10:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:22.122 15:10:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:22.122 15:10:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:22.122 15:10:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:22.122 15:10:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:22.122 15:10:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:22.122 15:10:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:22.122 15:10:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:22.122 15:10:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:22.122 15:10:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:22.122 15:10:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:22.122 15:10:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:22.123 15:10:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:22.123 15:10:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:22.123 15:10:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:22.123 15:10:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:22.123 15:10:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:22.123 15:10:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.123 15:10:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.123 15:10:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.123 15:10:02 -- paths/export.sh@5 -- # export PATH 00:22:22.123 15:10:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:22.123 15:10:02 -- nvmf/common.sh@47 -- # : 0 00:22:22.123 15:10:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:22.123 15:10:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:22.123 15:10:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:22.123 15:10:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:22.123 15:10:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:22.123 15:10:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:22.123 15:10:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:22.123 15:10:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:22.123 15:10:02 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:22.123 15:10:02 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:22.123 15:10:02 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:22:22.123 15:10:02 -- host/perf.sh@17 -- # nvmftestinit 00:22:22.123 15:10:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:22.123 15:10:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:22.123 15:10:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:22.123 15:10:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:22.123 15:10:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:22.123 15:10:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:22.123 15:10:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:22.123 15:10:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:22.123 15:10:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:22.123 15:10:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:22.123 15:10:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:22.123 15:10:02 -- common/autotest_common.sh@10 -- # set +x 00:22:28.717 15:10:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:28.717 15:10:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:28.717 15:10:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:28.717 15:10:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:28.717 15:10:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:28.717 15:10:09 -- nvmf/common.sh@295 -- # net_devs=() 00:22:28.717 15:10:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@296 -- # e810=() 00:22:28.717 15:10:09 -- nvmf/common.sh@296 -- # local -ga e810 00:22:28.717 15:10:09 -- nvmf/common.sh@297 -- # x722=() 00:22:28.717 15:10:09 -- nvmf/common.sh@297 -- # local -ga x722 00:22:28.717 15:10:09 -- nvmf/common.sh@298 -- # mlx=() 00:22:28.717 15:10:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:28.717 15:10:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:28.717 15:10:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:22:28.717 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:22:28.717 15:10:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:28.717 15:10:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:22:28.717 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:22:28.717 15:10:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:28.717 15:10:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.717 15:10:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.717 15:10:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:22:28.717 Found net devices under 0000:31:00.0: mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.717 15:10:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.717 15:10:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:22:28.717 Found net devices under 0000:31:00.1: mlx_0_1 00:22:28.717 15:10:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.717 15:10:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:28.717 15:10:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:28.717 15:10:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:28.717 15:10:09 -- nvmf/common.sh@58 -- # uname 00:22:28.717 15:10:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:28.717 15:10:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:28.717 15:10:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:28.717 15:10:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:28.717 15:10:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:28.717 15:10:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:28.717 15:10:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:28.717 15:10:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:28.717 15:10:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:28.717 15:10:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:28.717 15:10:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:28.717 15:10:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:28.717 15:10:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:28.717 15:10:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@105 -- # continue 2 00:22:28.717 15:10:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:28.717 15:10:09 -- nvmf/common.sh@105 -- # continue 2 00:22:28.717 15:10:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:28.717 15:10:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:28.717 15:10:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:28.717 15:10:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:28.717 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:28.717 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:22:28.717 altname enp49s0f0np0 00:22:28.717 altname ens786f0np0 00:22:28.717 inet 192.168.100.8/24 scope global mlx_0_0 00:22:28.717 valid_lft forever preferred_lft forever 00:22:28.717 15:10:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:28.717 15:10:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:28.717 15:10:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:28.717 15:10:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:28.717 15:10:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:28.717 15:10:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:28.717 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:28.717 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:22:28.717 altname enp49s0f1np1 00:22:28.717 altname ens786f1np1 00:22:28.717 inet 192.168.100.9/24 scope global mlx_0_1 00:22:28.717 valid_lft forever preferred_lft forever 00:22:28.717 15:10:09 -- nvmf/common.sh@411 -- # return 0 00:22:28.717 15:10:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:28.717 15:10:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:28.717 15:10:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:28.717 15:10:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:28.717 15:10:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:28.717 15:10:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:28.717 15:10:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:28.717 15:10:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:28.717 15:10:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:28.717 15:10:09 -- nvmf/common.sh@105 -- # continue 2 00:22:28.717 15:10:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:28.717 15:10:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:28.717 15:10:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:28.718 15:10:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:28.718 15:10:09 -- nvmf/common.sh@105 -- # continue 2 00:22:28.718 15:10:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:28.718 15:10:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:28.718 15:10:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:28.718 15:10:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:28.718 15:10:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:28.718 15:10:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:28.718 15:10:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:28.718 15:10:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:28.718 192.168.100.9' 00:22:28.718 15:10:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:28.718 192.168.100.9' 00:22:28.718 15:10:09 -- nvmf/common.sh@446 -- # head -n 1 00:22:28.718 15:10:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:28.718 15:10:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:28.718 192.168.100.9' 00:22:28.718 15:10:09 -- nvmf/common.sh@447 -- # tail -n +2 00:22:28.718 15:10:09 -- nvmf/common.sh@447 -- # head -n 1 00:22:28.718 15:10:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:28.718 15:10:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:28.718 15:10:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:28.718 15:10:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:28.718 15:10:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:28.718 15:10:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:28.718 15:10:09 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:28.718 15:10:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:28.718 15:10:09 -- common/autotest_common.sh@720 -- # xtrace_disable 00:22:28.718 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.718 15:10:09 -- nvmf/common.sh@470 -- # nvmfpid=3604347 00:22:28.718 15:10:09 -- nvmf/common.sh@471 -- # waitforlisten 3604347 00:22:28.718 15:10:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:28.718 15:10:09 -- common/autotest_common.sh@827 -- # '[' -z 3604347 ']' 00:22:28.718 15:10:09 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:28.718 15:10:09 -- common/autotest_common.sh@832 -- # local max_retries=100 00:22:28.718 15:10:09 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:28.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:28.718 15:10:09 -- common/autotest_common.sh@836 -- # xtrace_disable 00:22:28.718 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.979 [2024-04-26 15:10:09.703107] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:28.979 [2024-04-26 15:10:09.703176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:28.979 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.979 [2024-04-26 15:10:09.768256] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:28.979 [2024-04-26 15:10:09.841924] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:28.979 [2024-04-26 15:10:09.841964] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:28.979 [2024-04-26 15:10:09.841974] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:28.979 [2024-04-26 15:10:09.841981] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:28.979 [2024-04-26 15:10:09.841988] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:28.979 [2024-04-26 15:10:09.842112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:28.979 [2024-04-26 15:10:09.842247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:28.979 [2024-04-26 15:10:09.842379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:28.979 [2024-04-26 15:10:09.842382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:29.552 15:10:10 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:22:29.552 15:10:10 -- common/autotest_common.sh@860 -- # return 0 00:22:29.552 15:10:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:29.552 15:10:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:22:29.552 15:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:29.813 15:10:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:29.813 15:10:10 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:29.813 15:10:10 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:30.074 15:10:11 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:30.074 15:10:11 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:30.335 15:10:11 -- host/perf.sh@30 -- # local_nvme_trid=0000:65:00.0 00:22:30.335 15:10:11 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:30.596 15:10:11 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:30.596 15:10:11 -- host/perf.sh@33 -- # '[' -n 0000:65:00.0 ']' 00:22:30.596 15:10:11 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:30.596 15:10:11 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:22:30.596 15:10:11 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:22:30.596 [2024-04-26 15:10:11.503583] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:22:30.596 [2024-04-26 15:10:11.532550] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xed9ef0/0xf07b00) succeed. 00:22:30.856 [2024-04-26 15:10:11.545732] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xedb530/0xf67b00) succeed. 00:22:30.856 15:10:11 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:31.117 15:10:11 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:31.117 15:10:11 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:31.117 15:10:12 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:31.117 15:10:12 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:31.378 15:10:12 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:31.378 [2024-04-26 15:10:12.326810] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:31.640 15:10:12 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:31.640 15:10:12 -- host/perf.sh@52 -- # '[' -n 0000:65:00.0 ']' 00:22:31.640 15:10:12 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:22:31.640 15:10:12 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:22:31.640 15:10:12 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:65:00.0' 00:22:33.024 Initializing NVMe Controllers 00:22:33.024 Attached to NVMe Controller at 0000:65:00.0 [144d:a80a] 00:22:33.024 Associating PCIE (0000:65:00.0) NSID 1 with lcore 0 00:22:33.024 Initialization complete. Launching workers. 00:22:33.024 ======================================================== 00:22:33.024 Latency(us) 00:22:33.024 Device Information : IOPS MiB/s Average min max 00:22:33.024 PCIE (0000:65:00.0) NSID 1 from core 0: 79800.43 311.72 401.30 13.39 4985.57 00:22:33.024 ======================================================== 00:22:33.024 Total : 79800.43 311.72 401.30 13.39 4985.57 00:22:33.024 00:22:33.024 15:10:13 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:22:33.024 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.327 Initializing NVMe Controllers 00:22:36.327 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:36.327 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:36.327 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:36.327 Initialization complete. Launching workers. 00:22:36.327 ======================================================== 00:22:36.327 Latency(us) 00:22:36.327 Device Information : IOPS MiB/s Average min max 00:22:36.327 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7481.94 29.23 133.37 49.53 4075.72 00:22:36.327 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 7454.94 29.12 133.32 52.40 4079.46 00:22:36.327 ======================================================== 00:22:36.327 Total : 14936.88 58.35 133.34 49.53 4079.46 00:22:36.327 00:22:36.327 15:10:17 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:22:36.327 EAL: No free 2048 kB hugepages reported on node 1 00:22:40.531 Initializing NVMe Controllers 00:22:40.531 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:40.531 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:40.531 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:40.531 Initialization complete. Launching workers. 00:22:40.531 ======================================================== 00:22:40.531 Latency(us) 00:22:40.531 Device Information : IOPS MiB/s Average min max 00:22:40.531 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15094.98 58.96 2120.20 595.24 9103.74 00:22:40.531 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4000.00 15.62 8035.20 6922.52 12234.31 00:22:40.531 ======================================================== 00:22:40.531 Total : 19094.98 74.59 3359.26 595.24 12234.31 00:22:40.532 00:22:40.532 15:10:20 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:22:40.532 15:10:20 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:22:40.532 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.811 Initializing NVMe Controllers 00:22:44.811 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:44.811 Controller IO queue size 128, less than required. 00:22:44.811 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:44.811 Controller IO queue size 128, less than required. 00:22:44.811 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:44.811 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:44.811 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:44.811 Initialization complete. Launching workers. 00:22:44.811 ======================================================== 00:22:44.811 Latency(us) 00:22:44.811 Device Information : IOPS MiB/s Average min max 00:22:44.811 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3360.50 840.12 38298.94 15298.69 91834.02 00:22:44.811 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4639.50 1159.88 27311.61 10471.94 47570.91 00:22:44.811 ======================================================== 00:22:44.811 Total : 8000.00 2000.00 31926.98 10471.94 91834.02 00:22:44.811 00:22:44.811 15:10:25 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:22:44.811 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.811 No valid NVMe controllers or AIO or URING devices found 00:22:44.811 Initializing NVMe Controllers 00:22:44.811 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:44.811 Controller IO queue size 128, less than required. 00:22:44.811 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:44.811 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:22:44.811 Controller IO queue size 128, less than required. 00:22:44.811 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:44.811 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:22:44.811 WARNING: Some requested NVMe devices were skipped 00:22:44.811 15:10:25 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:22:44.811 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.012 Initializing NVMe Controllers 00:22:49.012 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:22:49.012 Controller IO queue size 128, less than required. 00:22:49.012 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.012 Controller IO queue size 128, less than required. 00:22:49.012 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:49.012 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:49.012 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:49.012 Initialization complete. Launching workers. 00:22:49.012 00:22:49.012 ==================== 00:22:49.012 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:22:49.012 RDMA transport: 00:22:49.012 dev name: mlx5_0 00:22:49.012 polls: 282599 00:22:49.012 idle_polls: 280450 00:22:49.012 completions: 39994 00:22:49.012 queued_requests: 1 00:22:49.012 total_send_wrs: 19997 00:22:49.012 send_doorbell_updates: 1899 00:22:49.012 total_recv_wrs: 20124 00:22:49.012 recv_doorbell_updates: 1901 00:22:49.012 --------------------------------- 00:22:49.012 00:22:49.012 ==================== 00:22:49.012 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:22:49.012 RDMA transport: 00:22:49.012 dev name: mlx5_0 00:22:49.012 polls: 288076 00:22:49.012 idle_polls: 287822 00:22:49.012 completions: 17894 00:22:49.012 queued_requests: 1 00:22:49.012 total_send_wrs: 8947 00:22:49.012 send_doorbell_updates: 248 00:22:49.012 total_recv_wrs: 9074 00:22:49.012 recv_doorbell_updates: 251 00:22:49.012 --------------------------------- 00:22:49.012 ======================================================== 00:22:49.012 Latency(us) 00:22:49.013 Device Information : IOPS MiB/s Average min max 00:22:49.013 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4992.65 1248.16 25615.87 14662.84 64961.59 00:22:49.013 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2233.66 558.42 57082.06 32068.46 86675.18 00:22:49.013 ======================================================== 00:22:49.013 Total : 7226.32 1806.58 35342.10 14662.84 86675.18 00:22:49.013 00:22:49.013 15:10:29 -- host/perf.sh@66 -- # sync 00:22:49.013 15:10:29 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:49.273 15:10:30 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:22:49.273 15:10:30 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:22:49.273 15:10:30 -- host/perf.sh@114 -- # nvmftestfini 00:22:49.273 15:10:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:49.273 15:10:30 -- nvmf/common.sh@117 -- # sync 00:22:49.273 15:10:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:49.273 15:10:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:49.273 15:10:30 -- nvmf/common.sh@120 -- # set +e 00:22:49.273 15:10:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:49.273 15:10:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:49.273 rmmod nvme_rdma 00:22:49.273 rmmod nvme_fabrics 00:22:49.273 15:10:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:49.273 15:10:30 -- nvmf/common.sh@124 -- # set -e 00:22:49.273 15:10:30 -- nvmf/common.sh@125 -- # return 0 00:22:49.273 15:10:30 -- nvmf/common.sh@478 -- # '[' -n 3604347 ']' 00:22:49.273 15:10:30 -- nvmf/common.sh@479 -- # killprocess 3604347 00:22:49.273 15:10:30 -- common/autotest_common.sh@946 -- # '[' -z 3604347 ']' 00:22:49.273 15:10:30 -- common/autotest_common.sh@950 -- # kill -0 3604347 00:22:49.273 15:10:30 -- common/autotest_common.sh@951 -- # uname 00:22:49.273 15:10:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:22:49.273 15:10:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3604347 00:22:49.273 15:10:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:22:49.273 15:10:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:22:49.273 15:10:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3604347' 00:22:49.273 killing process with pid 3604347 00:22:49.273 15:10:30 -- common/autotest_common.sh@965 -- # kill 3604347 00:22:49.273 15:10:30 -- common/autotest_common.sh@970 -- # wait 3604347 00:22:49.273 [2024-04-26 15:10:30.170820] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:51.822 15:10:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:51.822 15:10:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:51.822 00:22:51.822 real 0m29.378s 00:22:51.822 user 1m32.100s 00:22:51.822 sys 0m6.010s 00:22:51.822 15:10:32 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:22:51.822 15:10:32 -- common/autotest_common.sh@10 -- # set +x 00:22:51.822 ************************************ 00:22:51.822 END TEST nvmf_perf 00:22:51.822 ************************************ 00:22:51.822 15:10:32 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:22:51.822 15:10:32 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:22:51.822 15:10:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:22:51.822 15:10:32 -- common/autotest_common.sh@10 -- # set +x 00:22:51.822 ************************************ 00:22:51.822 START TEST nvmf_fio_host 00:22:51.822 ************************************ 00:22:51.822 15:10:32 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:22:51.822 * Looking for test storage... 00:22:51.822 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:51.822 15:10:32 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:51.822 15:10:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:51.822 15:10:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:51.822 15:10:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:51.822 15:10:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@5 -- # export PATH 00:22:51.822 15:10:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:51.822 15:10:32 -- nvmf/common.sh@7 -- # uname -s 00:22:51.822 15:10:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:51.822 15:10:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:51.822 15:10:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:51.822 15:10:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:51.822 15:10:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:51.822 15:10:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:51.822 15:10:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:51.822 15:10:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:51.822 15:10:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:51.822 15:10:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:51.822 15:10:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:51.822 15:10:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:22:51.822 15:10:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:51.822 15:10:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:51.822 15:10:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:51.822 15:10:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:51.822 15:10:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:51.822 15:10:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:51.822 15:10:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:51.822 15:10:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:51.822 15:10:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- paths/export.sh@5 -- # export PATH 00:22:51.822 15:10:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:51.822 15:10:32 -- nvmf/common.sh@47 -- # : 0 00:22:51.822 15:10:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:51.822 15:10:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:51.822 15:10:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:51.822 15:10:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:51.822 15:10:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:51.822 15:10:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:51.822 15:10:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:51.822 15:10:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:51.822 15:10:32 -- host/fio.sh@12 -- # nvmftestinit 00:22:51.822 15:10:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:51.822 15:10:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:51.822 15:10:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:51.822 15:10:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:51.822 15:10:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:51.822 15:10:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.822 15:10:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.822 15:10:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:51.822 15:10:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:51.822 15:10:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:51.822 15:10:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:51.822 15:10:32 -- common/autotest_common.sh@10 -- # set +x 00:22:58.417 15:10:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:58.417 15:10:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:58.417 15:10:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:58.417 15:10:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:58.417 15:10:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:58.417 15:10:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:58.417 15:10:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:58.417 15:10:38 -- nvmf/common.sh@295 -- # net_devs=() 00:22:58.417 15:10:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:58.417 15:10:38 -- nvmf/common.sh@296 -- # e810=() 00:22:58.417 15:10:38 -- nvmf/common.sh@296 -- # local -ga e810 00:22:58.417 15:10:38 -- nvmf/common.sh@297 -- # x722=() 00:22:58.417 15:10:38 -- nvmf/common.sh@297 -- # local -ga x722 00:22:58.417 15:10:38 -- nvmf/common.sh@298 -- # mlx=() 00:22:58.417 15:10:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:58.417 15:10:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:58.417 15:10:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:58.417 15:10:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:58.417 15:10:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:22:58.417 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:22:58.417 15:10:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:58.417 15:10:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:58.417 15:10:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:22:58.417 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:22:58.417 15:10:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:58.417 15:10:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:58.417 15:10:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:58.417 15:10:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:58.417 15:10:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:58.417 15:10:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:58.417 15:10:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:22:58.417 Found net devices under 0000:31:00.0: mlx_0_0 00:22:58.417 15:10:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:58.417 15:10:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:58.417 15:10:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:58.417 15:10:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:58.417 15:10:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:22:58.417 Found net devices under 0000:31:00.1: mlx_0_1 00:22:58.417 15:10:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:58.417 15:10:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:58.417 15:10:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:58.417 15:10:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:58.417 15:10:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:58.417 15:10:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:58.417 15:10:38 -- nvmf/common.sh@58 -- # uname 00:22:58.417 15:10:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:58.417 15:10:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:58.417 15:10:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:58.417 15:10:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:58.417 15:10:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:58.417 15:10:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:58.417 15:10:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:58.417 15:10:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:58.417 15:10:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:58.417 15:10:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:58.417 15:10:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:58.417 15:10:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:58.417 15:10:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:58.417 15:10:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:58.417 15:10:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:58.417 15:10:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:58.417 15:10:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:58.417 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.417 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:58.417 15:10:39 -- nvmf/common.sh@105 -- # continue 2 00:22:58.417 15:10:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:58.417 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.417 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.417 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:58.417 15:10:39 -- nvmf/common.sh@105 -- # continue 2 00:22:58.417 15:10:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:58.417 15:10:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:58.417 15:10:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:58.417 15:10:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:58.417 15:10:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:58.417 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:58.417 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:22:58.417 altname enp49s0f0np0 00:22:58.417 altname ens786f0np0 00:22:58.417 inet 192.168.100.8/24 scope global mlx_0_0 00:22:58.417 valid_lft forever preferred_lft forever 00:22:58.417 15:10:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:58.417 15:10:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:58.417 15:10:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:58.417 15:10:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:58.417 15:10:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:58.417 15:10:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:58.417 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:58.417 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:22:58.417 altname enp49s0f1np1 00:22:58.417 altname ens786f1np1 00:22:58.417 inet 192.168.100.9/24 scope global mlx_0_1 00:22:58.417 valid_lft forever preferred_lft forever 00:22:58.417 15:10:39 -- nvmf/common.sh@411 -- # return 0 00:22:58.417 15:10:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:58.417 15:10:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:58.417 15:10:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:58.417 15:10:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:58.417 15:10:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:58.417 15:10:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:58.417 15:10:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:58.417 15:10:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:58.417 15:10:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:58.417 15:10:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:58.417 15:10:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:58.418 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.418 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:58.418 15:10:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:58.418 15:10:39 -- nvmf/common.sh@105 -- # continue 2 00:22:58.418 15:10:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:58.418 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.418 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:58.418 15:10:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:58.418 15:10:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:58.418 15:10:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:58.418 15:10:39 -- nvmf/common.sh@105 -- # continue 2 00:22:58.418 15:10:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:58.418 15:10:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:58.418 15:10:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:58.418 15:10:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:58.418 15:10:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:58.418 15:10:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:58.418 15:10:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:58.418 15:10:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:58.418 192.168.100.9' 00:22:58.418 15:10:39 -- nvmf/common.sh@446 -- # head -n 1 00:22:58.418 15:10:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:58.418 192.168.100.9' 00:22:58.418 15:10:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:58.418 15:10:39 -- nvmf/common.sh@447 -- # tail -n +2 00:22:58.418 15:10:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:58.418 192.168.100.9' 00:22:58.418 15:10:39 -- nvmf/common.sh@447 -- # head -n 1 00:22:58.418 15:10:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:58.418 15:10:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:58.418 15:10:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:58.418 15:10:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:58.418 15:10:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:58.418 15:10:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:58.418 15:10:39 -- host/fio.sh@14 -- # [[ y != y ]] 00:22:58.418 15:10:39 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:22:58.418 15:10:39 -- common/autotest_common.sh@720 -- # xtrace_disable 00:22:58.418 15:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:58.418 15:10:39 -- host/fio.sh@22 -- # nvmfpid=3612377 00:22:58.418 15:10:39 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:58.418 15:10:39 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:58.418 15:10:39 -- host/fio.sh@26 -- # waitforlisten 3612377 00:22:58.418 15:10:39 -- common/autotest_common.sh@827 -- # '[' -z 3612377 ']' 00:22:58.418 15:10:39 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:58.418 15:10:39 -- common/autotest_common.sh@832 -- # local max_retries=100 00:22:58.418 15:10:39 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:58.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:58.418 15:10:39 -- common/autotest_common.sh@836 -- # xtrace_disable 00:22:58.418 15:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:58.418 [2024-04-26 15:10:39.206952] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:22:58.418 [2024-04-26 15:10:39.207020] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:58.418 EAL: No free 2048 kB hugepages reported on node 1 00:22:58.418 [2024-04-26 15:10:39.271609] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:58.418 [2024-04-26 15:10:39.344436] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:58.418 [2024-04-26 15:10:39.344477] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:58.418 [2024-04-26 15:10:39.344486] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:58.418 [2024-04-26 15:10:39.344494] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:58.418 [2024-04-26 15:10:39.344501] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:58.418 [2024-04-26 15:10:39.344688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:58.418 [2024-04-26 15:10:39.344814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:58.418 [2024-04-26 15:10:39.344969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:58.418 [2024-04-26 15:10:39.344972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:59.363 15:10:39 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:22:59.363 15:10:39 -- common/autotest_common.sh@860 -- # return 0 00:22:59.363 15:10:39 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:59.363 15:10:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 [2024-04-26 15:10:40.034573] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xbe0b00/0xbe4ff0) succeed. 00:22:59.363 [2024-04-26 15:10:40.047844] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xbe2140/0xc26680) succeed. 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:22:59.363 15:10:40 -- common/autotest_common.sh@726 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 15:10:40 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:59.363 15:10:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 Malloc1 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:59.363 15:10:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:59.363 15:10:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:59.363 15:10:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 [2024-04-26 15:10:40.268054] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:22:59.363 15:10:40 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:59.363 15:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:59.363 15:10:40 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:59.363 15:10:40 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:22:59.363 15:10:40 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:59.363 15:10:40 -- common/autotest_common.sh@1356 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:59.363 15:10:40 -- common/autotest_common.sh@1333 -- # local fio_dir=/usr/src/fio 00:22:59.363 15:10:40 -- common/autotest_common.sh@1335 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:59.363 15:10:40 -- common/autotest_common.sh@1335 -- # local sanitizers 00:22:59.363 15:10:40 -- common/autotest_common.sh@1336 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:59.363 15:10:40 -- common/autotest_common.sh@1337 -- # shift 00:22:59.363 15:10:40 -- common/autotest_common.sh@1339 -- # local asan_lib= 00:22:59.363 15:10:40 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:22:59.363 15:10:40 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:59.363 15:10:40 -- common/autotest_common.sh@1341 -- # grep libasan 00:22:59.363 15:10:40 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:22:59.656 15:10:40 -- common/autotest_common.sh@1341 -- # asan_lib= 00:22:59.656 15:10:40 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:22:59.656 15:10:40 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:22:59.656 15:10:40 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:22:59.657 15:10:40 -- common/autotest_common.sh@1341 -- # grep libclang_rt.asan 00:22:59.657 15:10:40 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:22:59.657 15:10:40 -- common/autotest_common.sh@1341 -- # asan_lib= 00:22:59.657 15:10:40 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:22:59.657 15:10:40 -- common/autotest_common.sh@1348 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:22:59.657 15:10:40 -- common/autotest_common.sh@1348 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:22:59.923 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:22:59.923 fio-3.35 00:22:59.923 Starting 1 thread 00:22:59.923 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.566 00:23:02.566 test: (groupid=0, jobs=1): err= 0: pid=3612884: Fri Apr 26 15:10:43 2024 00:23:02.566 read: IOPS=14.6k, BW=57.0MiB/s (59.8MB/s)(114MiB/2004msec) 00:23:02.566 slat (nsec): min=2037, max=33624, avg=2113.23, stdev=537.33 00:23:02.566 clat (usec): min=2346, max=7881, avg=4356.65, stdev=141.35 00:23:02.566 lat (usec): min=2372, max=7883, avg=4358.77, stdev=141.28 00:23:02.566 clat percentiles (usec): 00:23:02.566 | 1.00th=[ 3884], 5.00th=[ 4293], 10.00th=[ 4293], 20.00th=[ 4359], 00:23:02.566 | 30.00th=[ 4359], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[ 4359], 00:23:02.566 | 70.00th=[ 4359], 80.00th=[ 4359], 90.00th=[ 4424], 95.00th=[ 4424], 00:23:02.566 | 99.00th=[ 4752], 99.50th=[ 4817], 99.90th=[ 6194], 99.95th=[ 6783], 00:23:02.566 | 99.99th=[ 7832] 00:23:02.566 bw ( KiB/s): min=57312, max=59152, per=99.98%, avg=58372.00, stdev=805.49, samples=4 00:23:02.566 iops : min=14328, max=14788, avg=14593.00, stdev=201.37, samples=4 00:23:02.566 write: IOPS=14.6k, BW=57.1MiB/s (59.9MB/s)(115MiB/2004msec); 0 zone resets 00:23:02.566 slat (nsec): min=2111, max=12519, avg=2367.19, stdev=551.13 00:23:02.566 clat (usec): min=3287, max=7925, avg=4354.33, stdev=144.07 00:23:02.566 lat (usec): min=3300, max=7927, avg=4356.70, stdev=144.01 00:23:02.566 clat percentiles (usec): 00:23:02.566 | 1.00th=[ 3884], 5.00th=[ 4293], 10.00th=[ 4293], 20.00th=[ 4359], 00:23:02.566 | 30.00th=[ 4359], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[ 4359], 00:23:02.566 | 70.00th=[ 4359], 80.00th=[ 4359], 90.00th=[ 4359], 95.00th=[ 4424], 00:23:02.566 | 99.00th=[ 4752], 99.50th=[ 4817], 99.90th=[ 6587], 99.95th=[ 7308], 00:23:02.566 | 99.99th=[ 7898] 00:23:02.566 bw ( KiB/s): min=57616, max=59088, per=99.98%, avg=58504.00, stdev=668.75, samples=4 00:23:02.566 iops : min=14404, max=14772, avg=14626.00, stdev=167.19, samples=4 00:23:02.566 lat (msec) : 4=2.47%, 10=97.53% 00:23:02.566 cpu : usr=99.55%, sys=0.05%, ctx=15, majf=0, minf=12 00:23:02.566 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:23:02.566 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.566 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:02.566 issued rwts: total=29250,29315,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.566 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:02.566 00:23:02.566 Run status group 0 (all jobs): 00:23:02.566 READ: bw=57.0MiB/s (59.8MB/s), 57.0MiB/s-57.0MiB/s (59.8MB/s-59.8MB/s), io=114MiB (120MB), run=2004-2004msec 00:23:02.566 WRITE: bw=57.1MiB/s (59.9MB/s), 57.1MiB/s-57.1MiB/s (59.9MB/s-59.9MB/s), io=115MiB (120MB), run=2004-2004msec 00:23:02.566 15:10:43 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:23:02.566 15:10:43 -- common/autotest_common.sh@1356 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:23:02.566 15:10:43 -- common/autotest_common.sh@1333 -- # local fio_dir=/usr/src/fio 00:23:02.566 15:10:43 -- common/autotest_common.sh@1335 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:23:02.566 15:10:43 -- common/autotest_common.sh@1335 -- # local sanitizers 00:23:02.566 15:10:43 -- common/autotest_common.sh@1336 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:23:02.566 15:10:43 -- common/autotest_common.sh@1337 -- # shift 00:23:02.566 15:10:43 -- common/autotest_common.sh@1339 -- # local asan_lib= 00:23:02.566 15:10:43 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # grep libasan 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # asan_lib= 00:23:02.566 15:10:43 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:23:02.566 15:10:43 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # grep libclang_rt.asan 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:23:02.566 15:10:43 -- common/autotest_common.sh@1341 -- # asan_lib= 00:23:02.566 15:10:43 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:23:02.566 15:10:43 -- common/autotest_common.sh@1348 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:23:02.566 15:10:43 -- common/autotest_common.sh@1348 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:23:02.566 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:23:02.566 fio-3.35 00:23:02.566 Starting 1 thread 00:23:02.566 EAL: No free 2048 kB hugepages reported on node 1 00:23:05.114 00:23:05.114 test: (groupid=0, jobs=1): err= 0: pid=3613691: Fri Apr 26 15:10:45 2024 00:23:05.114 read: IOPS=13.0k, BW=203MiB/s (212MB/s)(401MiB/1978msec) 00:23:05.114 slat (nsec): min=3388, max=48439, avg=3668.50, stdev=1362.99 00:23:05.114 clat (usec): min=249, max=11255, avg=3250.11, stdev=1835.38 00:23:05.114 lat (usec): min=253, max=11278, avg=3253.78, stdev=1835.67 00:23:05.114 clat percentiles (usec): 00:23:05.114 | 1.00th=[ 881], 5.00th=[ 1188], 10.00th=[ 1352], 20.00th=[ 1614], 00:23:05.114 | 30.00th=[ 1926], 40.00th=[ 2245], 50.00th=[ 2737], 60.00th=[ 3294], 00:23:05.114 | 70.00th=[ 3916], 80.00th=[ 4883], 90.00th=[ 6259], 95.00th=[ 6783], 00:23:05.114 | 99.00th=[ 8291], 99.50th=[ 8586], 99.90th=[ 8979], 99.95th=[10159], 00:23:05.114 | 99.99th=[10945] 00:23:05.114 bw ( KiB/s): min=91680, max=109664, per=49.72%, avg=103114.67, stdev=9937.60, samples=3 00:23:05.114 iops : min= 5730, max= 6854, avg=6444.67, stdev=621.10, samples=3 00:23:05.114 write: IOPS=7196, BW=112MiB/s (118MB/s)(205MiB/1823msec); 0 zone resets 00:23:05.114 slat (usec): min=39, max=141, avg=41.41, stdev= 7.45 00:23:05.114 clat (usec): min=367, max=22603, avg=11306.21, stdev=5270.12 00:23:05.114 lat (usec): min=410, max=22643, avg=11347.62, stdev=5270.26 00:23:05.114 clat percentiles (usec): 00:23:05.114 | 1.00th=[ 2278], 5.00th=[ 3294], 10.00th=[ 4228], 20.00th=[ 5997], 00:23:05.114 | 30.00th=[ 7373], 40.00th=[ 8717], 50.00th=[10945], 60.00th=[14353], 00:23:05.114 | 70.00th=[15533], 80.00th=[16712], 90.00th=[17957], 95.00th=[19006], 00:23:05.114 | 99.00th=[20579], 99.50th=[20841], 99.90th=[21365], 99.95th=[21627], 00:23:05.114 | 99.99th=[22414] 00:23:05.114 bw ( KiB/s): min=97056, max=111104, per=92.31%, avg=106293.33, stdev=8002.07, samples=3 00:23:05.114 iops : min= 6066, max= 6944, avg=6643.33, stdev=500.13, samples=3 00:23:05.115 lat (usec) : 250=0.01%, 500=0.09%, 750=0.28%, 1000=1.03% 00:23:05.115 lat (msec) : 2=20.19%, 4=28.33%, 10=31.80%, 20=17.68%, 50=0.59% 00:23:05.115 cpu : usr=96.95%, sys=0.75%, ctx=184, majf=0, minf=15 00:23:05.115 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:23:05.115 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:05.115 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:23:05.115 issued rwts: total=25640,13119,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:05.115 latency : target=0, window=0, percentile=100.00%, depth=128 00:23:05.115 00:23:05.115 Run status group 0 (all jobs): 00:23:05.115 READ: bw=203MiB/s (212MB/s), 203MiB/s-203MiB/s (212MB/s-212MB/s), io=401MiB (420MB), run=1978-1978msec 00:23:05.115 WRITE: bw=112MiB/s (118MB/s), 112MiB/s-112MiB/s (118MB/s-118MB/s), io=205MiB (215MB), run=1823-1823msec 00:23:05.115 15:10:45 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:05.115 15:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:05.115 15:10:45 -- common/autotest_common.sh@10 -- # set +x 00:23:05.115 15:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:05.115 15:10:45 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:23:05.115 15:10:45 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:23:05.115 15:10:45 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:23:05.115 15:10:45 -- host/fio.sh@84 -- # nvmftestfini 00:23:05.115 15:10:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:05.115 15:10:45 -- nvmf/common.sh@117 -- # sync 00:23:05.115 15:10:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:05.115 15:10:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:05.115 15:10:45 -- nvmf/common.sh@120 -- # set +e 00:23:05.115 15:10:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:05.115 15:10:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:05.115 rmmod nvme_rdma 00:23:05.115 rmmod nvme_fabrics 00:23:05.115 15:10:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:05.115 15:10:45 -- nvmf/common.sh@124 -- # set -e 00:23:05.115 15:10:45 -- nvmf/common.sh@125 -- # return 0 00:23:05.115 15:10:45 -- nvmf/common.sh@478 -- # '[' -n 3612377 ']' 00:23:05.115 15:10:45 -- nvmf/common.sh@479 -- # killprocess 3612377 00:23:05.115 15:10:45 -- common/autotest_common.sh@946 -- # '[' -z 3612377 ']' 00:23:05.115 15:10:45 -- common/autotest_common.sh@950 -- # kill -0 3612377 00:23:05.115 15:10:45 -- common/autotest_common.sh@951 -- # uname 00:23:05.115 15:10:45 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:05.115 15:10:45 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3612377 00:23:05.115 15:10:45 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:23:05.115 15:10:45 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:23:05.115 15:10:45 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3612377' 00:23:05.115 killing process with pid 3612377 00:23:05.115 15:10:45 -- common/autotest_common.sh@965 -- # kill 3612377 00:23:05.115 15:10:45 -- common/autotest_common.sh@970 -- # wait 3612377 00:23:05.115 [2024-04-26 15:10:46.005458] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:05.376 15:10:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:05.376 15:10:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:05.376 00:23:05.376 real 0m13.822s 00:23:05.376 user 1m3.883s 00:23:05.376 sys 0m5.680s 00:23:05.376 15:10:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:05.376 15:10:46 -- common/autotest_common.sh@10 -- # set +x 00:23:05.376 ************************************ 00:23:05.376 END TEST nvmf_fio_host 00:23:05.376 ************************************ 00:23:05.376 15:10:46 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:23:05.376 15:10:46 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:05.376 15:10:46 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:05.376 15:10:46 -- common/autotest_common.sh@10 -- # set +x 00:23:05.638 ************************************ 00:23:05.638 START TEST nvmf_failover 00:23:05.638 ************************************ 00:23:05.638 15:10:46 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:23:05.638 * Looking for test storage... 00:23:05.638 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:05.638 15:10:46 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:05.638 15:10:46 -- nvmf/common.sh@7 -- # uname -s 00:23:05.638 15:10:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:05.638 15:10:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:05.638 15:10:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:05.638 15:10:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:05.638 15:10:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:05.638 15:10:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:05.638 15:10:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:05.638 15:10:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:05.638 15:10:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:05.638 15:10:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:05.638 15:10:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:05.638 15:10:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:05.638 15:10:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:05.638 15:10:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:05.638 15:10:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:05.638 15:10:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:05.638 15:10:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:05.638 15:10:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:05.638 15:10:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:05.638 15:10:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:05.638 15:10:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.638 15:10:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.638 15:10:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.638 15:10:46 -- paths/export.sh@5 -- # export PATH 00:23:05.638 15:10:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:05.638 15:10:46 -- nvmf/common.sh@47 -- # : 0 00:23:05.638 15:10:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:05.638 15:10:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:05.638 15:10:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:05.638 15:10:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:05.638 15:10:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:05.638 15:10:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:05.638 15:10:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:05.638 15:10:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:05.638 15:10:46 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:05.638 15:10:46 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:05.638 15:10:46 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:23:05.638 15:10:46 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:05.638 15:10:46 -- host/failover.sh@18 -- # nvmftestinit 00:23:05.638 15:10:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:05.638 15:10:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:05.638 15:10:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:05.638 15:10:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:05.638 15:10:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:05.638 15:10:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.638 15:10:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.638 15:10:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:05.638 15:10:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:05.638 15:10:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:05.638 15:10:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:05.638 15:10:46 -- common/autotest_common.sh@10 -- # set +x 00:23:13.787 15:10:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:13.787 15:10:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:13.787 15:10:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:13.787 15:10:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:13.787 15:10:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:13.787 15:10:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:13.787 15:10:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:13.787 15:10:53 -- nvmf/common.sh@295 -- # net_devs=() 00:23:13.787 15:10:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:13.787 15:10:53 -- nvmf/common.sh@296 -- # e810=() 00:23:13.787 15:10:53 -- nvmf/common.sh@296 -- # local -ga e810 00:23:13.787 15:10:53 -- nvmf/common.sh@297 -- # x722=() 00:23:13.787 15:10:53 -- nvmf/common.sh@297 -- # local -ga x722 00:23:13.787 15:10:53 -- nvmf/common.sh@298 -- # mlx=() 00:23:13.787 15:10:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:13.788 15:10:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:13.788 15:10:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:23:13.788 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:23:13.788 15:10:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:13.788 15:10:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:23:13.788 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:23:13.788 15:10:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:13.788 15:10:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.788 15:10:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.788 15:10:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:23:13.788 Found net devices under 0000:31:00.0: mlx_0_0 00:23:13.788 15:10:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.788 15:10:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.788 15:10:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:23:13.788 Found net devices under 0000:31:00.1: mlx_0_1 00:23:13.788 15:10:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.788 15:10:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:13.788 15:10:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:13.788 15:10:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:13.788 15:10:53 -- nvmf/common.sh@58 -- # uname 00:23:13.788 15:10:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:13.788 15:10:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:13.788 15:10:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:13.788 15:10:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:13.788 15:10:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:13.788 15:10:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:13.788 15:10:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:13.788 15:10:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:13.788 15:10:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:13.788 15:10:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:13.788 15:10:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:13.788 15:10:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:13.788 15:10:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:13.788 15:10:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:13.788 15:10:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:13.788 15:10:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:13.788 15:10:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:13.788 15:10:53 -- nvmf/common.sh@105 -- # continue 2 00:23:13.788 15:10:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.788 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:13.788 15:10:53 -- nvmf/common.sh@105 -- # continue 2 00:23:13.788 15:10:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:13.788 15:10:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:13.788 15:10:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:13.788 15:10:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:13.788 15:10:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:13.788 15:10:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:13.788 15:10:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:13.788 15:10:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:13.788 15:10:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:13.788 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:13.788 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:23:13.788 altname enp49s0f0np0 00:23:13.788 altname ens786f0np0 00:23:13.788 inet 192.168.100.8/24 scope global mlx_0_0 00:23:13.789 valid_lft forever preferred_lft forever 00:23:13.789 15:10:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:13.789 15:10:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:13.789 15:10:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:13.789 15:10:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:13.789 15:10:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:13.789 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:13.789 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:23:13.789 altname enp49s0f1np1 00:23:13.789 altname ens786f1np1 00:23:13.789 inet 192.168.100.9/24 scope global mlx_0_1 00:23:13.789 valid_lft forever preferred_lft forever 00:23:13.789 15:10:53 -- nvmf/common.sh@411 -- # return 0 00:23:13.789 15:10:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:13.789 15:10:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:13.789 15:10:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:13.789 15:10:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:13.789 15:10:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:13.789 15:10:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:13.789 15:10:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:13.789 15:10:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:13.789 15:10:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:13.789 15:10:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:13.789 15:10:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:13.789 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.789 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:13.789 15:10:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:13.789 15:10:53 -- nvmf/common.sh@105 -- # continue 2 00:23:13.789 15:10:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:13.789 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.789 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:13.789 15:10:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:13.789 15:10:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:13.789 15:10:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@105 -- # continue 2 00:23:13.789 15:10:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:13.789 15:10:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:13.789 15:10:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:13.789 15:10:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:13.789 15:10:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:13.789 15:10:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:13.789 15:10:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:13.789 192.168.100.9' 00:23:13.789 15:10:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:13.789 192.168.100.9' 00:23:13.789 15:10:53 -- nvmf/common.sh@446 -- # head -n 1 00:23:13.789 15:10:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:13.789 15:10:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:13.789 192.168.100.9' 00:23:13.789 15:10:53 -- nvmf/common.sh@447 -- # tail -n +2 00:23:13.789 15:10:53 -- nvmf/common.sh@447 -- # head -n 1 00:23:13.789 15:10:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:13.789 15:10:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:13.789 15:10:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:13.789 15:10:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:13.789 15:10:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:13.789 15:10:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:13.789 15:10:53 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:23:13.789 15:10:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:13.789 15:10:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:13.789 15:10:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.789 15:10:53 -- nvmf/common.sh@470 -- # nvmfpid=3617865 00:23:13.789 15:10:53 -- nvmf/common.sh@471 -- # waitforlisten 3617865 00:23:13.789 15:10:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:13.789 15:10:53 -- common/autotest_common.sh@827 -- # '[' -z 3617865 ']' 00:23:13.789 15:10:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:13.789 15:10:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:13.789 15:10:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:13.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:13.789 15:10:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:13.789 15:10:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.789 [2024-04-26 15:10:53.528033] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:23:13.789 [2024-04-26 15:10:53.528102] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:13.789 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.789 [2024-04-26 15:10:53.594594] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:13.789 [2024-04-26 15:10:53.668889] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:13.789 [2024-04-26 15:10:53.668930] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:13.789 [2024-04-26 15:10:53.668937] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:13.789 [2024-04-26 15:10:53.668949] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:13.789 [2024-04-26 15:10:53.668954] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:13.789 [2024-04-26 15:10:53.669064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:13.789 [2024-04-26 15:10:53.669208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:13.790 [2024-04-26 15:10:53.669211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:13.790 15:10:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:13.790 15:10:54 -- common/autotest_common.sh@860 -- # return 0 00:23:13.790 15:10:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:13.790 15:10:54 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:13.790 15:10:54 -- common/autotest_common.sh@10 -- # set +x 00:23:13.790 15:10:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:13.790 15:10:54 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:23:13.790 [2024-04-26 15:10:54.527767] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19da2f0/0x19de7e0) succeed. 00:23:13.790 [2024-04-26 15:10:54.541515] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x19db890/0x1a1fe70) succeed. 00:23:13.790 15:10:54 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:23:14.051 Malloc0 00:23:14.051 15:10:54 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:14.312 15:10:55 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:14.312 15:10:55 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:14.573 [2024-04-26 15:10:55.319404] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:14.573 15:10:55 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:23:14.573 [2024-04-26 15:10:55.487663] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:23:14.573 15:10:55 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:23:14.835 [2024-04-26 15:10:55.656261] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:23:14.835 15:10:55 -- host/failover.sh@31 -- # bdevperf_pid=3618377 00:23:14.835 15:10:55 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:14.835 15:10:55 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:23:14.835 15:10:55 -- host/failover.sh@34 -- # waitforlisten 3618377 /var/tmp/bdevperf.sock 00:23:14.835 15:10:55 -- common/autotest_common.sh@827 -- # '[' -z 3618377 ']' 00:23:14.835 15:10:55 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:14.835 15:10:55 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:14.835 15:10:55 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:14.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:14.835 15:10:55 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:14.835 15:10:55 -- common/autotest_common.sh@10 -- # set +x 00:23:15.776 15:10:56 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:15.776 15:10:56 -- common/autotest_common.sh@860 -- # return 0 00:23:15.776 15:10:56 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:16.037 NVMe0n1 00:23:16.037 15:10:56 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:16.037 00:23:16.299 15:10:56 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:16.299 15:10:56 -- host/failover.sh@39 -- # run_test_pid=3618576 00:23:16.299 15:10:56 -- host/failover.sh@41 -- # sleep 1 00:23:17.240 15:10:57 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:17.240 15:10:58 -- host/failover.sh@45 -- # sleep 3 00:23:20.543 15:11:01 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:20.544 00:23:20.544 15:11:01 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:23:20.804 15:11:01 -- host/failover.sh@50 -- # sleep 3 00:23:24.108 15:11:04 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:24.108 [2024-04-26 15:11:04.743712] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:24.108 15:11:04 -- host/failover.sh@55 -- # sleep 1 00:23:25.052 15:11:05 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:23:25.052 15:11:05 -- host/failover.sh@59 -- # wait 3618576 00:23:31.645 0 00:23:31.645 15:11:12 -- host/failover.sh@61 -- # killprocess 3618377 00:23:31.645 15:11:12 -- common/autotest_common.sh@946 -- # '[' -z 3618377 ']' 00:23:31.645 15:11:12 -- common/autotest_common.sh@950 -- # kill -0 3618377 00:23:31.645 15:11:12 -- common/autotest_common.sh@951 -- # uname 00:23:31.645 15:11:12 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:31.645 15:11:12 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3618377 00:23:31.645 15:11:12 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:23:31.645 15:11:12 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:23:31.645 15:11:12 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3618377' 00:23:31.645 killing process with pid 3618377 00:23:31.645 15:11:12 -- common/autotest_common.sh@965 -- # kill 3618377 00:23:31.645 15:11:12 -- common/autotest_common.sh@970 -- # wait 3618377 00:23:31.645 15:11:12 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:31.645 [2024-04-26 15:10:55.730674] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:23:31.645 [2024-04-26 15:10:55.730730] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3618377 ] 00:23:31.645 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.645 [2024-04-26 15:10:55.789265] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:31.645 [2024-04-26 15:10:55.851347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:31.645 Running I/O for 15 seconds... 00:23:31.645 [2024-04-26 15:10:59.145698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:125176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:125184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:125192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:125200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:125208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:125216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:125224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:125232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.645 [2024-04-26 15:10:59.145881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:125240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x18cd00 00:23:31.645 [2024-04-26 15:10:59.145889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:125248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:125256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:125264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:125272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:125280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.145988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:125288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.145995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:125296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:125304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:125312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:125320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:125328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:125336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:125344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:125352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:125360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:125368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:125376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:125384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:125392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:125400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:125408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:125416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:125424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:125432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:125440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:125448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:125456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:125464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:125472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:125480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:125488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:125496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:125504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:125512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:125520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:125528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:125536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:125544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:125552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:125560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:125568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:125576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:125584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:125592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:125600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:125608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:125616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:125624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:125632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:125640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:125648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:125656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:125664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:125672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:125680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:125688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:125696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:125704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:125712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:125720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x18cd00 00:23:31.646 [2024-04-26 15:10:59.146903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.646 [2024-04-26 15:10:59.146912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:125728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.146919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.146930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:125736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.146937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.146947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:125744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.146954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.146963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:125752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.146970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.146980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:125760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.146988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.146998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:125768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:125776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:125784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:125792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:125800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:125808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:125816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:125824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:125832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:125840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:125848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:125856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:125864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:125872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:125880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:125888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:125896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:125904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:125912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:125920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:125928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:125936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:125944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x18cd00 00:23:31.647 [2024-04-26 15:10:59.147373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:125952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:125960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:125968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:125976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:125984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:125992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:126000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:126008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:126016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:126024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:126032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:126040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:126048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:126056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:126064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:126072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:126080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:126088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:126096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:126104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:126112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:126120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:126128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:126136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:126144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:126152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:126160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.647 [2024-04-26 15:10:59.147813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.647 [2024-04-26 15:10:59.147826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:126168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:10:59.147833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.147842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:126176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:10:59.155801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.155838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:126184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:10:59.155846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.157711] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:23:31.648 [2024-04-26 15:10:59.157739] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:23:31.648 [2024-04-26 15:10:59.157749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:126192 len:8 PRP1 0x0 PRP2 0x0 00:23:31.648 [2024-04-26 15:10:59.157760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.157797] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:23:31.648 [2024-04-26 15:10:59.157807] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:23:31.648 [2024-04-26 15:10:59.157815] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:31.648 [2024-04-26 15:10:59.157860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:31.648 [2024-04-26 15:10:59.157871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.157880] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:31.648 [2024-04-26 15:10:59.157887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.157895] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:31.648 [2024-04-26 15:10:59.157902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.157909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:23:31.648 [2024-04-26 15:10:59.157917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:10:59.177101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:31.648 [2024-04-26 15:10:59.177115] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:23:31.648 [2024-04-26 15:10:59.177122] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:23:31.648 [2024-04-26 15:10:59.180691] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:31.648 [2024-04-26 15:10:59.231357] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:31.648 [2024-04-26 15:11:02.581348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:20712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:20360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:20368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:20376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:20384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:20392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:20728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:20744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:20752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:20760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:20768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:20776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:20416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:20424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:20432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:20440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:20448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:20464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:20472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x18cd00 00:23:31.648 [2024-04-26 15:11:02.581863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:20792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:20808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:20816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:20824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:20832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.581985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:20840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.581993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.582010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:20856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.582026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:20864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.582042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:20872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.582059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:20880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.648 [2024-04-26 15:11:02.582076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.648 [2024-04-26 15:11:02.582085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:20896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:20912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:20920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:20936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:20944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:20952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:20960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:20968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:20976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:20984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:20992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:21000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:21008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:21016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:21024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:21032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:21040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:21048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:21056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:21072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:21080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:21088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:21096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:20488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:20496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:20504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:20512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:20520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:20528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:20536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:21104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:21112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:21120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:21128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:21136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:21152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:21160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x18cd00 00:23:31.649 [2024-04-26 15:11:02.582803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:21176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:21200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:21208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:21216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:21224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:21232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.582990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:21256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.582998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.583007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:21264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.583014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.583023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:21272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.583031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.583040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:21280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.583047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.649 [2024-04-26 15:11:02.583056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:21288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.649 [2024-04-26 15:11:02.583063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:20568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:20576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:20592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:20608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:20616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:20624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:20640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:20648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:20656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:20672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:21312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:21320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:21328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:21344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:02.583464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:20680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.583489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:02.583496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.585156] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:23:31.650 [2024-04-26 15:11:02.585168] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:23:31.650 [2024-04-26 15:11:02.585175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20696 len:8 PRP1 0x0 PRP2 0x0 00:23:31.650 [2024-04-26 15:11:02.585183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:02.585215] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:23:31.650 [2024-04-26 15:11:02.585224] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:23:31.650 [2024-04-26 15:11:02.585231] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:31.650 [2024-04-26 15:11:02.588750] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:31.650 [2024-04-26 15:11:02.608032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:31.650 [2024-04-26 15:11:02.663919] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:31.650 [2024-04-26 15:11:06.927313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:79896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:79904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:79912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:79920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:79928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:79936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:79944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:79952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:79960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:79968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:79976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:79984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:79520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:79528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:79536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:79992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:80000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:80008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:80016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:80024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:80032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:80040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:80048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.650 [2024-04-26 15:11:06.927740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:79544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:79552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:79560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:79568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.650 [2024-04-26 15:11:06.927819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:79576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x18cd00 00:23:31.650 [2024-04-26 15:11:06.927826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:80056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:80064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:80072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:80080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:80088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:80096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:79584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.927941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:80104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:80112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.927984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:80120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.927991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:80128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:80136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:80144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:80152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:80160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:79592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:79600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:79608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:79616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:79624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:79632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:79640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:79648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:80168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:80176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:80184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:80192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:80200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:80208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:80216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:80224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.651 [2024-04-26 15:11:06.928342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:79656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:79664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:79672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:79680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:79688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:79696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:79704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:79712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:79720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:79728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:79736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:79744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:79752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:79760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:79768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:79776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:79784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:79792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:79800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:79808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x18cd00 00:23:31.651 [2024-04-26 15:11:06.928687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.651 [2024-04-26 15:11:06.928696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.928703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:79824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.928719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:79832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.928736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:79840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.928756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:80232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:80240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:80248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:80256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:80264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:80272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:80280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:80288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:80296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:80304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:80312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:80320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:80328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:80336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.928987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.928996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:80344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:80352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:80360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:80368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:80376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:80384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:80392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:80400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:80408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:79848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.929149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:79856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.929167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:80416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:80424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:80432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:80440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:80448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:80456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:80464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:80472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:80480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:80488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:80496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:80504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:80512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:80520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:80528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:80536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:23:31.652 [2024-04-26 15:11:06.929433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:79864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.929450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:79872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.929466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.929475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:79880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x18cd00 00:23:31.652 [2024-04-26 15:11:06.929482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8020 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.931221] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:23:31.652 [2024-04-26 15:11:06.931233] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:23:31.652 [2024-04-26 15:11:06.931240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:79888 len:8 PRP1 0x0 PRP2 0x0 00:23:31.652 [2024-04-26 15:11:06.931247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:31.652 [2024-04-26 15:11:06.931280] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:23:31.652 [2024-04-26 15:11:06.931289] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:23:31.652 [2024-04-26 15:11:06.931297] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:31.652 [2024-04-26 15:11:06.934847] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:31.652 [2024-04-26 15:11:06.953770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:31.652 [2024-04-26 15:11:07.004963] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:31.652 00:23:31.652 Latency(us) 00:23:31.652 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:31.652 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:23:31.652 Verification LBA range: start 0x0 length 0x4000 00:23:31.652 NVMe0n1 : 15.01 12145.13 47.44 257.81 0.00 10291.16 348.16 1041585.49 00:23:31.652 =================================================================================================================== 00:23:31.652 Total : 12145.13 47.44 257.81 0.00 10291.16 348.16 1041585.49 00:23:31.652 Received shutdown signal, test time was about 15.000000 seconds 00:23:31.652 00:23:31.652 Latency(us) 00:23:31.652 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:31.652 =================================================================================================================== 00:23:31.652 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:31.652 15:11:12 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:23:31.652 15:11:12 -- host/failover.sh@65 -- # count=3 00:23:31.652 15:11:12 -- host/failover.sh@67 -- # (( count != 3 )) 00:23:31.652 15:11:12 -- host/failover.sh@73 -- # bdevperf_pid=3621437 00:23:31.652 15:11:12 -- host/failover.sh@75 -- # waitforlisten 3621437 /var/tmp/bdevperf.sock 00:23:31.652 15:11:12 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:23:31.652 15:11:12 -- common/autotest_common.sh@827 -- # '[' -z 3621437 ']' 00:23:31.652 15:11:12 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:31.652 15:11:12 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:31.653 15:11:12 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:31.653 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:31.653 15:11:12 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:31.653 15:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:32.225 15:11:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:32.225 15:11:13 -- common/autotest_common.sh@860 -- # return 0 00:23:32.225 15:11:13 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:23:32.487 [2024-04-26 15:11:13.308543] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:23:32.487 15:11:13 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:23:32.748 [2024-04-26 15:11:13.477111] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:23:32.748 15:11:13 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:33.009 NVMe0n1 00:23:33.009 15:11:13 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:33.270 00:23:33.270 15:11:13 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:33.270 00:23:33.531 15:11:14 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:33.531 15:11:14 -- host/failover.sh@82 -- # grep -q NVMe0 00:23:33.531 15:11:14 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:33.793 15:11:14 -- host/failover.sh@87 -- # sleep 3 00:23:37.092 15:11:17 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:37.092 15:11:17 -- host/failover.sh@88 -- # grep -q NVMe0 00:23:37.092 15:11:17 -- host/failover.sh@90 -- # run_test_pid=3622540 00:23:37.092 15:11:17 -- host/failover.sh@92 -- # wait 3622540 00:23:37.092 15:11:17 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:38.033 0 00:23:38.033 15:11:18 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:38.033 [2024-04-26 15:11:12.385199] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:23:38.033 [2024-04-26 15:11:12.385258] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3621437 ] 00:23:38.033 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.033 [2024-04-26 15:11:12.444137] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:38.033 [2024-04-26 15:11:12.504187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:38.033 [2024-04-26 15:11:14.538586] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:23:38.033 [2024-04-26 15:11:14.539210] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:38.033 [2024-04-26 15:11:14.539243] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:23:38.033 [2024-04-26 15:11:14.564421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:38.033 [2024-04-26 15:11:14.590383] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:38.033 Running I/O for 1 seconds... 00:23:38.033 00:23:38.033 Latency(us) 00:23:38.033 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:38.033 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:23:38.033 Verification LBA range: start 0x0 length 0x4000 00:23:38.033 NVMe0n1 : 1.01 16931.74 66.14 0.00 0.00 7514.04 2034.35 17803.95 00:23:38.033 =================================================================================================================== 00:23:38.033 Total : 16931.74 66.14 0.00 0.00 7514.04 2034.35 17803.95 00:23:38.033 15:11:18 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:38.033 15:11:18 -- host/failover.sh@95 -- # grep -q NVMe0 00:23:38.294 15:11:19 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:38.294 15:11:19 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:38.294 15:11:19 -- host/failover.sh@99 -- # grep -q NVMe0 00:23:38.555 15:11:19 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:38.816 15:11:19 -- host/failover.sh@101 -- # sleep 3 00:23:42.121 15:11:22 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:42.121 15:11:22 -- host/failover.sh@103 -- # grep -q NVMe0 00:23:42.121 15:11:22 -- host/failover.sh@108 -- # killprocess 3621437 00:23:42.121 15:11:22 -- common/autotest_common.sh@946 -- # '[' -z 3621437 ']' 00:23:42.121 15:11:22 -- common/autotest_common.sh@950 -- # kill -0 3621437 00:23:42.121 15:11:22 -- common/autotest_common.sh@951 -- # uname 00:23:42.121 15:11:22 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:42.121 15:11:22 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3621437 00:23:42.121 15:11:22 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:23:42.121 15:11:22 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:23:42.121 15:11:22 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3621437' 00:23:42.121 killing process with pid 3621437 00:23:42.121 15:11:22 -- common/autotest_common.sh@965 -- # kill 3621437 00:23:42.121 15:11:22 -- common/autotest_common.sh@970 -- # wait 3621437 00:23:42.121 15:11:22 -- host/failover.sh@110 -- # sync 00:23:42.121 15:11:22 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:42.381 15:11:23 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:23:42.381 15:11:23 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:42.381 15:11:23 -- host/failover.sh@116 -- # nvmftestfini 00:23:42.381 15:11:23 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:42.381 15:11:23 -- nvmf/common.sh@117 -- # sync 00:23:42.381 15:11:23 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:42.381 15:11:23 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:42.381 15:11:23 -- nvmf/common.sh@120 -- # set +e 00:23:42.381 15:11:23 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:42.381 15:11:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:42.381 rmmod nvme_rdma 00:23:42.381 rmmod nvme_fabrics 00:23:42.381 15:11:23 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:42.381 15:11:23 -- nvmf/common.sh@124 -- # set -e 00:23:42.381 15:11:23 -- nvmf/common.sh@125 -- # return 0 00:23:42.381 15:11:23 -- nvmf/common.sh@478 -- # '[' -n 3617865 ']' 00:23:42.381 15:11:23 -- nvmf/common.sh@479 -- # killprocess 3617865 00:23:42.381 15:11:23 -- common/autotest_common.sh@946 -- # '[' -z 3617865 ']' 00:23:42.381 15:11:23 -- common/autotest_common.sh@950 -- # kill -0 3617865 00:23:42.381 15:11:23 -- common/autotest_common.sh@951 -- # uname 00:23:42.381 15:11:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:42.381 15:11:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3617865 00:23:42.381 15:11:23 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:23:42.381 15:11:23 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:23:42.381 15:11:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3617865' 00:23:42.381 killing process with pid 3617865 00:23:42.381 15:11:23 -- common/autotest_common.sh@965 -- # kill 3617865 00:23:42.381 15:11:23 -- common/autotest_common.sh@970 -- # wait 3617865 00:23:42.381 [2024-04-26 15:11:23.274024] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:42.642 15:11:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:42.642 15:11:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:42.642 00:23:42.642 real 0m37.087s 00:23:42.642 user 2m2.099s 00:23:42.642 sys 0m6.961s 00:23:42.642 15:11:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:42.642 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:23:42.642 ************************************ 00:23:42.642 END TEST nvmf_failover 00:23:42.642 ************************************ 00:23:42.642 15:11:23 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:23:42.642 15:11:23 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:42.642 15:11:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:42.642 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:23:42.903 ************************************ 00:23:42.903 START TEST nvmf_discovery 00:23:42.904 ************************************ 00:23:42.904 15:11:23 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:23:42.904 * Looking for test storage... 00:23:42.904 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:42.904 15:11:23 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:42.904 15:11:23 -- nvmf/common.sh@7 -- # uname -s 00:23:42.904 15:11:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:42.904 15:11:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:42.904 15:11:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:42.904 15:11:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:42.904 15:11:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:42.904 15:11:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:42.904 15:11:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:42.904 15:11:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:42.904 15:11:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:42.904 15:11:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:42.904 15:11:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:42.904 15:11:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:42.904 15:11:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:42.904 15:11:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:42.904 15:11:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:42.904 15:11:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:42.904 15:11:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:42.904 15:11:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:42.904 15:11:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:42.904 15:11:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:42.904 15:11:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:42.904 15:11:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:42.904 15:11:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:42.904 15:11:23 -- paths/export.sh@5 -- # export PATH 00:23:42.904 15:11:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:42.904 15:11:23 -- nvmf/common.sh@47 -- # : 0 00:23:42.904 15:11:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:42.904 15:11:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:42.904 15:11:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:42.904 15:11:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:42.904 15:11:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:42.904 15:11:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:42.904 15:11:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:42.904 15:11:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:42.904 15:11:23 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:23:42.904 15:11:23 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:23:42.904 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:23:42.904 15:11:23 -- host/discovery.sh@13 -- # exit 0 00:23:42.904 00:23:42.904 real 0m0.132s 00:23:42.904 user 0m0.056s 00:23:42.904 sys 0m0.085s 00:23:42.904 15:11:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:42.904 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:23:42.904 ************************************ 00:23:42.904 END TEST nvmf_discovery 00:23:42.904 ************************************ 00:23:42.904 15:11:23 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:23:42.904 15:11:23 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:42.904 15:11:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:42.904 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:23:43.164 ************************************ 00:23:43.164 START TEST nvmf_discovery_remove_ifc 00:23:43.164 ************************************ 00:23:43.164 15:11:23 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:23:43.164 * Looking for test storage... 00:23:43.164 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:43.164 15:11:24 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:43.164 15:11:24 -- nvmf/common.sh@7 -- # uname -s 00:23:43.164 15:11:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:43.164 15:11:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:43.164 15:11:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:43.164 15:11:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:43.164 15:11:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:43.164 15:11:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:43.164 15:11:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:43.164 15:11:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:43.164 15:11:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:43.164 15:11:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:43.164 15:11:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:43.164 15:11:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:43.164 15:11:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:43.164 15:11:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:43.164 15:11:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:43.164 15:11:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:43.164 15:11:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:43.164 15:11:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:43.164 15:11:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:43.164 15:11:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:43.164 15:11:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.165 15:11:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.165 15:11:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.165 15:11:24 -- paths/export.sh@5 -- # export PATH 00:23:43.165 15:11:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.165 15:11:24 -- nvmf/common.sh@47 -- # : 0 00:23:43.165 15:11:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:43.165 15:11:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:43.165 15:11:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:43.165 15:11:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:43.165 15:11:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:43.165 15:11:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:43.165 15:11:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:43.165 15:11:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:43.165 15:11:24 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:23:43.165 15:11:24 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:23:43.165 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:23:43.165 15:11:24 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:23:43.165 00:23:43.165 real 0m0.132s 00:23:43.165 user 0m0.060s 00:23:43.165 sys 0m0.081s 00:23:43.165 15:11:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:43.165 15:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:43.165 ************************************ 00:23:43.165 END TEST nvmf_discovery_remove_ifc 00:23:43.165 ************************************ 00:23:43.165 15:11:24 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:23:43.165 15:11:24 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:43.165 15:11:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:43.165 15:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:43.425 ************************************ 00:23:43.425 START TEST nvmf_identify_kernel_target 00:23:43.425 ************************************ 00:23:43.425 15:11:24 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:23:43.425 * Looking for test storage... 00:23:43.425 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:43.425 15:11:24 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:43.425 15:11:24 -- nvmf/common.sh@7 -- # uname -s 00:23:43.425 15:11:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:43.425 15:11:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:43.425 15:11:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:43.425 15:11:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:43.425 15:11:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:43.425 15:11:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:43.425 15:11:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:43.425 15:11:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:43.425 15:11:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:43.425 15:11:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:43.425 15:11:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:43.425 15:11:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:43.687 15:11:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:43.687 15:11:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:43.687 15:11:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:43.687 15:11:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:43.687 15:11:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:43.687 15:11:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:43.687 15:11:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:43.687 15:11:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:43.687 15:11:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.687 15:11:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.687 15:11:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.687 15:11:24 -- paths/export.sh@5 -- # export PATH 00:23:43.687 15:11:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:43.687 15:11:24 -- nvmf/common.sh@47 -- # : 0 00:23:43.687 15:11:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:43.687 15:11:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:43.687 15:11:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:43.687 15:11:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:43.687 15:11:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:43.687 15:11:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:43.687 15:11:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:43.687 15:11:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:43.687 15:11:24 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:23:43.687 15:11:24 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:43.687 15:11:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:43.687 15:11:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:43.687 15:11:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:43.687 15:11:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:43.687 15:11:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:43.687 15:11:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:43.687 15:11:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:43.687 15:11:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:43.687 15:11:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:43.687 15:11:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:43.687 15:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:50.278 15:11:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:50.278 15:11:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:50.278 15:11:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:50.278 15:11:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:50.278 15:11:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:50.278 15:11:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:50.278 15:11:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:50.278 15:11:31 -- nvmf/common.sh@295 -- # net_devs=() 00:23:50.278 15:11:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:50.278 15:11:31 -- nvmf/common.sh@296 -- # e810=() 00:23:50.278 15:11:31 -- nvmf/common.sh@296 -- # local -ga e810 00:23:50.278 15:11:31 -- nvmf/common.sh@297 -- # x722=() 00:23:50.278 15:11:31 -- nvmf/common.sh@297 -- # local -ga x722 00:23:50.278 15:11:31 -- nvmf/common.sh@298 -- # mlx=() 00:23:50.278 15:11:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:50.278 15:11:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:50.278 15:11:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:50.278 15:11:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:50.278 15:11:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:50.278 15:11:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:50.278 15:11:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:50.278 15:11:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:50.278 15:11:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:23:50.279 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:23:50.279 15:11:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:50.279 15:11:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:23:50.279 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:23:50.279 15:11:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:50.279 15:11:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:50.279 15:11:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:50.279 15:11:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:23:50.279 Found net devices under 0000:31:00.0: mlx_0_0 00:23:50.279 15:11:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:50.279 15:11:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:50.279 15:11:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:50.279 15:11:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:23:50.279 Found net devices under 0000:31:00.1: mlx_0_1 00:23:50.279 15:11:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:50.279 15:11:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:50.279 15:11:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:50.279 15:11:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:50.279 15:11:31 -- nvmf/common.sh@58 -- # uname 00:23:50.279 15:11:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:50.279 15:11:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:50.279 15:11:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:50.279 15:11:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:50.279 15:11:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:50.279 15:11:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:50.279 15:11:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:50.279 15:11:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:50.279 15:11:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:50.279 15:11:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:50.279 15:11:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:50.279 15:11:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:50.279 15:11:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:50.279 15:11:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:50.279 15:11:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:50.279 15:11:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:50.279 15:11:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:50.279 15:11:31 -- nvmf/common.sh@105 -- # continue 2 00:23:50.279 15:11:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.279 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:50.279 15:11:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:50.279 15:11:31 -- nvmf/common.sh@105 -- # continue 2 00:23:50.279 15:11:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:50.279 15:11:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:50.279 15:11:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:50.279 15:11:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:50.279 15:11:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:50.541 15:11:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:50.541 15:11:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:50.541 15:11:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:50.541 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:50.541 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:23:50.541 altname enp49s0f0np0 00:23:50.541 altname ens786f0np0 00:23:50.541 inet 192.168.100.8/24 scope global mlx_0_0 00:23:50.541 valid_lft forever preferred_lft forever 00:23:50.541 15:11:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:50.541 15:11:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:50.541 15:11:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:50.541 15:11:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:50.541 15:11:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:50.541 15:11:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:50.541 15:11:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:50.541 15:11:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:50.541 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:50.541 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:23:50.541 altname enp49s0f1np1 00:23:50.541 altname ens786f1np1 00:23:50.541 inet 192.168.100.9/24 scope global mlx_0_1 00:23:50.541 valid_lft forever preferred_lft forever 00:23:50.541 15:11:31 -- nvmf/common.sh@411 -- # return 0 00:23:50.541 15:11:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:50.541 15:11:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:50.541 15:11:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:50.541 15:11:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:50.541 15:11:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:50.541 15:11:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:50.541 15:11:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:50.541 15:11:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:50.541 15:11:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:50.541 15:11:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:50.541 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.541 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:50.541 15:11:31 -- nvmf/common.sh@105 -- # continue 2 00:23:50.541 15:11:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:50.541 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.541 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:50.541 15:11:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:50.541 15:11:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:50.541 15:11:31 -- nvmf/common.sh@105 -- # continue 2 00:23:50.542 15:11:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:50.542 15:11:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:50.542 15:11:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:50.542 15:11:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:50.542 15:11:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:50.542 15:11:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:50.542 15:11:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:50.542 15:11:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:50.542 192.168.100.9' 00:23:50.542 15:11:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:50.542 192.168.100.9' 00:23:50.542 15:11:31 -- nvmf/common.sh@446 -- # head -n 1 00:23:50.542 15:11:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:50.542 15:11:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:50.542 192.168.100.9' 00:23:50.542 15:11:31 -- nvmf/common.sh@447 -- # tail -n +2 00:23:50.542 15:11:31 -- nvmf/common.sh@447 -- # head -n 1 00:23:50.542 15:11:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:50.542 15:11:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:50.542 15:11:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:50.542 15:11:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:50.542 15:11:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:50.542 15:11:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:50.542 15:11:31 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:23:50.542 15:11:31 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:23:50.542 15:11:31 -- nvmf/common.sh@717 -- # local ip 00:23:50.542 15:11:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:23:50.542 15:11:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:23:50.542 15:11:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:23:50.542 15:11:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:23:50.542 15:11:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:23:50.542 15:11:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:23:50.542 15:11:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:23:50.542 15:11:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:23:50.542 15:11:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:23:50.542 15:11:31 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:23:50.542 15:11:31 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:23:50.542 15:11:31 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:23:50.542 15:11:31 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:23:50.542 15:11:31 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:50.542 15:11:31 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:50.542 15:11:31 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:23:50.542 15:11:31 -- nvmf/common.sh@628 -- # local block nvme 00:23:50.542 15:11:31 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:23:50.542 15:11:31 -- nvmf/common.sh@631 -- # modprobe nvmet 00:23:50.542 15:11:31 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:23:50.542 15:11:31 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:23:53.847 Waiting for block devices as requested 00:23:53.847 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:23:53.847 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:23:53.847 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:23:53.847 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:23:53.847 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:23:54.108 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:23:54.108 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:23:54.108 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:23:54.370 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:23:54.370 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:23:54.370 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:23:54.631 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:23:54.631 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:23:54.631 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:23:54.631 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:23:54.892 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:23:54.892 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:23:54.892 15:11:35 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:23:54.892 15:11:35 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:23:54.892 15:11:35 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:23:54.892 15:11:35 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:23:54.892 15:11:35 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:23:54.892 15:11:35 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:23:54.892 15:11:35 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:23:54.892 15:11:35 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:23:54.892 15:11:35 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:23:54.892 No valid GPT data, bailing 00:23:54.892 15:11:35 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:23:54.892 15:11:35 -- scripts/common.sh@391 -- # pt= 00:23:54.892 15:11:35 -- scripts/common.sh@392 -- # return 1 00:23:54.892 15:11:35 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:23:54.892 15:11:35 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:23:54.892 15:11:35 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:54.892 15:11:35 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:54.892 15:11:35 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:23:54.892 15:11:35 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:23:54.892 15:11:35 -- nvmf/common.sh@656 -- # echo 1 00:23:54.892 15:11:35 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:23:54.892 15:11:35 -- nvmf/common.sh@658 -- # echo 1 00:23:54.892 15:11:35 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:23:54.892 15:11:35 -- nvmf/common.sh@661 -- # echo rdma 00:23:54.892 15:11:35 -- nvmf/common.sh@662 -- # echo 4420 00:23:54.892 15:11:35 -- nvmf/common.sh@663 -- # echo ipv4 00:23:54.892 15:11:35 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:23:54.892 15:11:35 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -a 192.168.100.8 -t rdma -s 4420 00:23:55.153 00:23:55.153 Discovery Log Number of Records 2, Generation counter 2 00:23:55.153 =====Discovery Log Entry 0====== 00:23:55.153 trtype: rdma 00:23:55.153 adrfam: ipv4 00:23:55.153 subtype: current discovery subsystem 00:23:55.153 treq: not specified, sq flow control disable supported 00:23:55.153 portid: 1 00:23:55.153 trsvcid: 4420 00:23:55.153 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:23:55.153 traddr: 192.168.100.8 00:23:55.153 eflags: none 00:23:55.153 rdma_prtype: not specified 00:23:55.153 rdma_qptype: connected 00:23:55.153 rdma_cms: rdma-cm 00:23:55.153 rdma_pkey: 0x0000 00:23:55.153 =====Discovery Log Entry 1====== 00:23:55.153 trtype: rdma 00:23:55.153 adrfam: ipv4 00:23:55.153 subtype: nvme subsystem 00:23:55.153 treq: not specified, sq flow control disable supported 00:23:55.153 portid: 1 00:23:55.153 trsvcid: 4420 00:23:55.153 subnqn: nqn.2016-06.io.spdk:testnqn 00:23:55.153 traddr: 192.168.100.8 00:23:55.153 eflags: none 00:23:55.153 rdma_prtype: not specified 00:23:55.153 rdma_qptype: connected 00:23:55.153 rdma_cms: rdma-cm 00:23:55.154 rdma_pkey: 0x0000 00:23:55.154 15:11:35 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:23:55.154 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:23:55.154 EAL: No free 2048 kB hugepages reported on node 1 00:23:55.154 ===================================================== 00:23:55.154 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:55.154 ===================================================== 00:23:55.154 Controller Capabilities/Features 00:23:55.154 ================================ 00:23:55.154 Vendor ID: 0000 00:23:55.154 Subsystem Vendor ID: 0000 00:23:55.154 Serial Number: 9872f4b71dfe049520bc 00:23:55.154 Model Number: Linux 00:23:55.154 Firmware Version: 6.7.0-68 00:23:55.154 Recommended Arb Burst: 0 00:23:55.154 IEEE OUI Identifier: 00 00 00 00:23:55.154 Multi-path I/O 00:23:55.154 May have multiple subsystem ports: No 00:23:55.154 May have multiple controllers: No 00:23:55.154 Associated with SR-IOV VF: No 00:23:55.154 Max Data Transfer Size: Unlimited 00:23:55.154 Max Number of Namespaces: 0 00:23:55.154 Max Number of I/O Queues: 1024 00:23:55.154 NVMe Specification Version (VS): 1.3 00:23:55.154 NVMe Specification Version (Identify): 1.3 00:23:55.154 Maximum Queue Entries: 128 00:23:55.154 Contiguous Queues Required: No 00:23:55.154 Arbitration Mechanisms Supported 00:23:55.154 Weighted Round Robin: Not Supported 00:23:55.154 Vendor Specific: Not Supported 00:23:55.154 Reset Timeout: 7500 ms 00:23:55.154 Doorbell Stride: 4 bytes 00:23:55.154 NVM Subsystem Reset: Not Supported 00:23:55.154 Command Sets Supported 00:23:55.154 NVM Command Set: Supported 00:23:55.154 Boot Partition: Not Supported 00:23:55.154 Memory Page Size Minimum: 4096 bytes 00:23:55.154 Memory Page Size Maximum: 4096 bytes 00:23:55.154 Persistent Memory Region: Not Supported 00:23:55.154 Optional Asynchronous Events Supported 00:23:55.154 Namespace Attribute Notices: Not Supported 00:23:55.154 Firmware Activation Notices: Not Supported 00:23:55.154 ANA Change Notices: Not Supported 00:23:55.154 PLE Aggregate Log Change Notices: Not Supported 00:23:55.154 LBA Status Info Alert Notices: Not Supported 00:23:55.154 EGE Aggregate Log Change Notices: Not Supported 00:23:55.154 Normal NVM Subsystem Shutdown event: Not Supported 00:23:55.154 Zone Descriptor Change Notices: Not Supported 00:23:55.154 Discovery Log Change Notices: Supported 00:23:55.154 Controller Attributes 00:23:55.154 128-bit Host Identifier: Not Supported 00:23:55.154 Non-Operational Permissive Mode: Not Supported 00:23:55.154 NVM Sets: Not Supported 00:23:55.154 Read Recovery Levels: Not Supported 00:23:55.154 Endurance Groups: Not Supported 00:23:55.154 Predictable Latency Mode: Not Supported 00:23:55.154 Traffic Based Keep ALive: Not Supported 00:23:55.154 Namespace Granularity: Not Supported 00:23:55.154 SQ Associations: Not Supported 00:23:55.154 UUID List: Not Supported 00:23:55.154 Multi-Domain Subsystem: Not Supported 00:23:55.154 Fixed Capacity Management: Not Supported 00:23:55.154 Variable Capacity Management: Not Supported 00:23:55.154 Delete Endurance Group: Not Supported 00:23:55.154 Delete NVM Set: Not Supported 00:23:55.154 Extended LBA Formats Supported: Not Supported 00:23:55.154 Flexible Data Placement Supported: Not Supported 00:23:55.154 00:23:55.154 Controller Memory Buffer Support 00:23:55.154 ================================ 00:23:55.154 Supported: No 00:23:55.154 00:23:55.154 Persistent Memory Region Support 00:23:55.154 ================================ 00:23:55.154 Supported: No 00:23:55.154 00:23:55.154 Admin Command Set Attributes 00:23:55.154 ============================ 00:23:55.154 Security Send/Receive: Not Supported 00:23:55.154 Format NVM: Not Supported 00:23:55.154 Firmware Activate/Download: Not Supported 00:23:55.154 Namespace Management: Not Supported 00:23:55.154 Device Self-Test: Not Supported 00:23:55.154 Directives: Not Supported 00:23:55.154 NVMe-MI: Not Supported 00:23:55.154 Virtualization Management: Not Supported 00:23:55.154 Doorbell Buffer Config: Not Supported 00:23:55.154 Get LBA Status Capability: Not Supported 00:23:55.154 Command & Feature Lockdown Capability: Not Supported 00:23:55.154 Abort Command Limit: 1 00:23:55.154 Async Event Request Limit: 1 00:23:55.154 Number of Firmware Slots: N/A 00:23:55.154 Firmware Slot 1 Read-Only: N/A 00:23:55.154 Firmware Activation Without Reset: N/A 00:23:55.154 Multiple Update Detection Support: N/A 00:23:55.154 Firmware Update Granularity: No Information Provided 00:23:55.154 Per-Namespace SMART Log: No 00:23:55.154 Asymmetric Namespace Access Log Page: Not Supported 00:23:55.154 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:55.154 Command Effects Log Page: Not Supported 00:23:55.154 Get Log Page Extended Data: Supported 00:23:55.154 Telemetry Log Pages: Not Supported 00:23:55.154 Persistent Event Log Pages: Not Supported 00:23:55.154 Supported Log Pages Log Page: May Support 00:23:55.154 Commands Supported & Effects Log Page: Not Supported 00:23:55.154 Feature Identifiers & Effects Log Page:May Support 00:23:55.154 NVMe-MI Commands & Effects Log Page: May Support 00:23:55.154 Data Area 4 for Telemetry Log: Not Supported 00:23:55.154 Error Log Page Entries Supported: 1 00:23:55.154 Keep Alive: Not Supported 00:23:55.154 00:23:55.154 NVM Command Set Attributes 00:23:55.154 ========================== 00:23:55.154 Submission Queue Entry Size 00:23:55.154 Max: 1 00:23:55.154 Min: 1 00:23:55.154 Completion Queue Entry Size 00:23:55.154 Max: 1 00:23:55.154 Min: 1 00:23:55.154 Number of Namespaces: 0 00:23:55.154 Compare Command: Not Supported 00:23:55.154 Write Uncorrectable Command: Not Supported 00:23:55.154 Dataset Management Command: Not Supported 00:23:55.154 Write Zeroes Command: Not Supported 00:23:55.154 Set Features Save Field: Not Supported 00:23:55.154 Reservations: Not Supported 00:23:55.154 Timestamp: Not Supported 00:23:55.154 Copy: Not Supported 00:23:55.154 Volatile Write Cache: Not Present 00:23:55.154 Atomic Write Unit (Normal): 1 00:23:55.154 Atomic Write Unit (PFail): 1 00:23:55.154 Atomic Compare & Write Unit: 1 00:23:55.154 Fused Compare & Write: Not Supported 00:23:55.154 Scatter-Gather List 00:23:55.154 SGL Command Set: Supported 00:23:55.154 SGL Keyed: Supported 00:23:55.154 SGL Bit Bucket Descriptor: Not Supported 00:23:55.154 SGL Metadata Pointer: Not Supported 00:23:55.154 Oversized SGL: Not Supported 00:23:55.154 SGL Metadata Address: Not Supported 00:23:55.154 SGL Offset: Supported 00:23:55.154 Transport SGL Data Block: Not Supported 00:23:55.154 Replay Protected Memory Block: Not Supported 00:23:55.154 00:23:55.154 Firmware Slot Information 00:23:55.154 ========================= 00:23:55.154 Active slot: 0 00:23:55.154 00:23:55.154 00:23:55.154 Error Log 00:23:55.154 ========= 00:23:55.154 00:23:55.154 Active Namespaces 00:23:55.154 ================= 00:23:55.154 Discovery Log Page 00:23:55.154 ================== 00:23:55.154 Generation Counter: 2 00:23:55.154 Number of Records: 2 00:23:55.154 Record Format: 0 00:23:55.154 00:23:55.154 Discovery Log Entry 0 00:23:55.154 ---------------------- 00:23:55.154 Transport Type: 1 (RDMA) 00:23:55.154 Address Family: 1 (IPv4) 00:23:55.154 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:55.154 Entry Flags: 00:23:55.154 Duplicate Returned Information: 0 00:23:55.154 Explicit Persistent Connection Support for Discovery: 0 00:23:55.154 Transport Requirements: 00:23:55.154 Secure Channel: Not Specified 00:23:55.154 Port ID: 1 (0x0001) 00:23:55.154 Controller ID: 65535 (0xffff) 00:23:55.154 Admin Max SQ Size: 32 00:23:55.154 Transport Service Identifier: 4420 00:23:55.154 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:55.154 Transport Address: 192.168.100.8 00:23:55.154 Transport Specific Address Subtype - RDMA 00:23:55.154 RDMA QP Service Type: 1 (Reliable Connected) 00:23:55.154 RDMA Provider Type: 1 (No provider specified) 00:23:55.154 RDMA CM Service: 1 (RDMA_CM) 00:23:55.154 Discovery Log Entry 1 00:23:55.154 ---------------------- 00:23:55.154 Transport Type: 1 (RDMA) 00:23:55.154 Address Family: 1 (IPv4) 00:23:55.154 Subsystem Type: 2 (NVM Subsystem) 00:23:55.154 Entry Flags: 00:23:55.154 Duplicate Returned Information: 0 00:23:55.154 Explicit Persistent Connection Support for Discovery: 0 00:23:55.154 Transport Requirements: 00:23:55.154 Secure Channel: Not Specified 00:23:55.154 Port ID: 1 (0x0001) 00:23:55.154 Controller ID: 65535 (0xffff) 00:23:55.154 Admin Max SQ Size: 32 00:23:55.154 Transport Service Identifier: 4420 00:23:55.154 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:23:55.154 Transport Address: 192.168.100.8 00:23:55.154 Transport Specific Address Subtype - RDMA 00:23:55.154 RDMA QP Service Type: 1 (Reliable Connected) 00:23:55.154 RDMA Provider Type: 1 (No provider specified) 00:23:55.154 RDMA CM Service: 1 (RDMA_CM) 00:23:55.154 15:11:36 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:23:55.415 EAL: No free 2048 kB hugepages reported on node 1 00:23:55.415 get_feature(0x01) failed 00:23:55.415 get_feature(0x02) failed 00:23:55.415 get_feature(0x04) failed 00:23:55.415 ===================================================== 00:23:55.415 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:23:55.415 ===================================================== 00:23:55.415 Controller Capabilities/Features 00:23:55.415 ================================ 00:23:55.415 Vendor ID: 0000 00:23:55.415 Subsystem Vendor ID: 0000 00:23:55.415 Serial Number: f520458608ee88383f81 00:23:55.415 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:23:55.415 Firmware Version: 6.7.0-68 00:23:55.415 Recommended Arb Burst: 6 00:23:55.415 IEEE OUI Identifier: 00 00 00 00:23:55.415 Multi-path I/O 00:23:55.415 May have multiple subsystem ports: Yes 00:23:55.415 May have multiple controllers: Yes 00:23:55.415 Associated with SR-IOV VF: No 00:23:55.415 Max Data Transfer Size: 1048576 00:23:55.415 Max Number of Namespaces: 1024 00:23:55.415 Max Number of I/O Queues: 128 00:23:55.415 NVMe Specification Version (VS): 1.3 00:23:55.415 NVMe Specification Version (Identify): 1.3 00:23:55.415 Maximum Queue Entries: 128 00:23:55.415 Contiguous Queues Required: No 00:23:55.415 Arbitration Mechanisms Supported 00:23:55.415 Weighted Round Robin: Not Supported 00:23:55.415 Vendor Specific: Not Supported 00:23:55.415 Reset Timeout: 7500 ms 00:23:55.415 Doorbell Stride: 4 bytes 00:23:55.415 NVM Subsystem Reset: Not Supported 00:23:55.415 Command Sets Supported 00:23:55.415 NVM Command Set: Supported 00:23:55.415 Boot Partition: Not Supported 00:23:55.415 Memory Page Size Minimum: 4096 bytes 00:23:55.415 Memory Page Size Maximum: 4096 bytes 00:23:55.415 Persistent Memory Region: Not Supported 00:23:55.415 Optional Asynchronous Events Supported 00:23:55.415 Namespace Attribute Notices: Supported 00:23:55.415 Firmware Activation Notices: Not Supported 00:23:55.415 ANA Change Notices: Supported 00:23:55.415 PLE Aggregate Log Change Notices: Not Supported 00:23:55.415 LBA Status Info Alert Notices: Not Supported 00:23:55.415 EGE Aggregate Log Change Notices: Not Supported 00:23:55.415 Normal NVM Subsystem Shutdown event: Not Supported 00:23:55.415 Zone Descriptor Change Notices: Not Supported 00:23:55.415 Discovery Log Change Notices: Not Supported 00:23:55.415 Controller Attributes 00:23:55.415 128-bit Host Identifier: Supported 00:23:55.415 Non-Operational Permissive Mode: Not Supported 00:23:55.415 NVM Sets: Not Supported 00:23:55.415 Read Recovery Levels: Not Supported 00:23:55.415 Endurance Groups: Not Supported 00:23:55.415 Predictable Latency Mode: Not Supported 00:23:55.415 Traffic Based Keep ALive: Supported 00:23:55.415 Namespace Granularity: Not Supported 00:23:55.415 SQ Associations: Not Supported 00:23:55.415 UUID List: Not Supported 00:23:55.415 Multi-Domain Subsystem: Not Supported 00:23:55.415 Fixed Capacity Management: Not Supported 00:23:55.415 Variable Capacity Management: Not Supported 00:23:55.415 Delete Endurance Group: Not Supported 00:23:55.415 Delete NVM Set: Not Supported 00:23:55.415 Extended LBA Formats Supported: Not Supported 00:23:55.415 Flexible Data Placement Supported: Not Supported 00:23:55.415 00:23:55.415 Controller Memory Buffer Support 00:23:55.415 ================================ 00:23:55.415 Supported: No 00:23:55.415 00:23:55.415 Persistent Memory Region Support 00:23:55.415 ================================ 00:23:55.415 Supported: No 00:23:55.415 00:23:55.415 Admin Command Set Attributes 00:23:55.415 ============================ 00:23:55.415 Security Send/Receive: Not Supported 00:23:55.415 Format NVM: Not Supported 00:23:55.415 Firmware Activate/Download: Not Supported 00:23:55.415 Namespace Management: Not Supported 00:23:55.415 Device Self-Test: Not Supported 00:23:55.415 Directives: Not Supported 00:23:55.415 NVMe-MI: Not Supported 00:23:55.415 Virtualization Management: Not Supported 00:23:55.415 Doorbell Buffer Config: Not Supported 00:23:55.415 Get LBA Status Capability: Not Supported 00:23:55.415 Command & Feature Lockdown Capability: Not Supported 00:23:55.415 Abort Command Limit: 4 00:23:55.415 Async Event Request Limit: 4 00:23:55.415 Number of Firmware Slots: N/A 00:23:55.415 Firmware Slot 1 Read-Only: N/A 00:23:55.415 Firmware Activation Without Reset: N/A 00:23:55.415 Multiple Update Detection Support: N/A 00:23:55.415 Firmware Update Granularity: No Information Provided 00:23:55.415 Per-Namespace SMART Log: Yes 00:23:55.415 Asymmetric Namespace Access Log Page: Supported 00:23:55.415 ANA Transition Time : 10 sec 00:23:55.415 00:23:55.415 Asymmetric Namespace Access Capabilities 00:23:55.415 ANA Optimized State : Supported 00:23:55.415 ANA Non-Optimized State : Supported 00:23:55.415 ANA Inaccessible State : Supported 00:23:55.415 ANA Persistent Loss State : Supported 00:23:55.415 ANA Change State : Supported 00:23:55.415 ANAGRPID is not changed : No 00:23:55.415 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:23:55.415 00:23:55.415 ANA Group Identifier Maximum : 128 00:23:55.415 Number of ANA Group Identifiers : 128 00:23:55.415 Max Number of Allowed Namespaces : 1024 00:23:55.415 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:23:55.415 Command Effects Log Page: Supported 00:23:55.415 Get Log Page Extended Data: Supported 00:23:55.415 Telemetry Log Pages: Not Supported 00:23:55.415 Persistent Event Log Pages: Not Supported 00:23:55.415 Supported Log Pages Log Page: May Support 00:23:55.415 Commands Supported & Effects Log Page: Not Supported 00:23:55.415 Feature Identifiers & Effects Log Page:May Support 00:23:55.415 NVMe-MI Commands & Effects Log Page: May Support 00:23:55.415 Data Area 4 for Telemetry Log: Not Supported 00:23:55.415 Error Log Page Entries Supported: 128 00:23:55.415 Keep Alive: Supported 00:23:55.415 Keep Alive Granularity: 1000 ms 00:23:55.415 00:23:55.415 NVM Command Set Attributes 00:23:55.415 ========================== 00:23:55.415 Submission Queue Entry Size 00:23:55.415 Max: 64 00:23:55.415 Min: 64 00:23:55.415 Completion Queue Entry Size 00:23:55.415 Max: 16 00:23:55.415 Min: 16 00:23:55.415 Number of Namespaces: 1024 00:23:55.415 Compare Command: Not Supported 00:23:55.415 Write Uncorrectable Command: Not Supported 00:23:55.415 Dataset Management Command: Supported 00:23:55.415 Write Zeroes Command: Supported 00:23:55.415 Set Features Save Field: Not Supported 00:23:55.415 Reservations: Not Supported 00:23:55.415 Timestamp: Not Supported 00:23:55.415 Copy: Not Supported 00:23:55.415 Volatile Write Cache: Present 00:23:55.415 Atomic Write Unit (Normal): 1 00:23:55.415 Atomic Write Unit (PFail): 1 00:23:55.415 Atomic Compare & Write Unit: 1 00:23:55.415 Fused Compare & Write: Not Supported 00:23:55.415 Scatter-Gather List 00:23:55.415 SGL Command Set: Supported 00:23:55.415 SGL Keyed: Supported 00:23:55.415 SGL Bit Bucket Descriptor: Not Supported 00:23:55.415 SGL Metadata Pointer: Not Supported 00:23:55.415 Oversized SGL: Not Supported 00:23:55.415 SGL Metadata Address: Not Supported 00:23:55.415 SGL Offset: Supported 00:23:55.415 Transport SGL Data Block: Not Supported 00:23:55.415 Replay Protected Memory Block: Not Supported 00:23:55.415 00:23:55.415 Firmware Slot Information 00:23:55.415 ========================= 00:23:55.415 Active slot: 0 00:23:55.415 00:23:55.415 Asymmetric Namespace Access 00:23:55.415 =========================== 00:23:55.415 Change Count : 0 00:23:55.415 Number of ANA Group Descriptors : 1 00:23:55.415 ANA Group Descriptor : 0 00:23:55.415 ANA Group ID : 1 00:23:55.415 Number of NSID Values : 1 00:23:55.415 Change Count : 0 00:23:55.415 ANA State : 1 00:23:55.415 Namespace Identifier : 1 00:23:55.415 00:23:55.415 Commands Supported and Effects 00:23:55.415 ============================== 00:23:55.415 Admin Commands 00:23:55.415 -------------- 00:23:55.415 Get Log Page (02h): Supported 00:23:55.415 Identify (06h): Supported 00:23:55.415 Abort (08h): Supported 00:23:55.415 Set Features (09h): Supported 00:23:55.415 Get Features (0Ah): Supported 00:23:55.415 Asynchronous Event Request (0Ch): Supported 00:23:55.415 Keep Alive (18h): Supported 00:23:55.415 I/O Commands 00:23:55.415 ------------ 00:23:55.415 Flush (00h): Supported 00:23:55.415 Write (01h): Supported LBA-Change 00:23:55.415 Read (02h): Supported 00:23:55.415 Write Zeroes (08h): Supported LBA-Change 00:23:55.415 Dataset Management (09h): Supported 00:23:55.415 00:23:55.415 Error Log 00:23:55.415 ========= 00:23:55.415 Entry: 0 00:23:55.415 Error Count: 0x3 00:23:55.415 Submission Queue Id: 0x0 00:23:55.415 Command Id: 0x5 00:23:55.415 Phase Bit: 0 00:23:55.415 Status Code: 0x2 00:23:55.415 Status Code Type: 0x0 00:23:55.415 Do Not Retry: 1 00:23:55.415 Error Location: 0x28 00:23:55.415 LBA: 0x0 00:23:55.415 Namespace: 0x0 00:23:55.415 Vendor Log Page: 0x0 00:23:55.415 ----------- 00:23:55.415 Entry: 1 00:23:55.415 Error Count: 0x2 00:23:55.415 Submission Queue Id: 0x0 00:23:55.416 Command Id: 0x5 00:23:55.416 Phase Bit: 0 00:23:55.416 Status Code: 0x2 00:23:55.416 Status Code Type: 0x0 00:23:55.416 Do Not Retry: 1 00:23:55.416 Error Location: 0x28 00:23:55.416 LBA: 0x0 00:23:55.416 Namespace: 0x0 00:23:55.416 Vendor Log Page: 0x0 00:23:55.416 ----------- 00:23:55.416 Entry: 2 00:23:55.416 Error Count: 0x1 00:23:55.416 Submission Queue Id: 0x0 00:23:55.416 Command Id: 0x0 00:23:55.416 Phase Bit: 0 00:23:55.416 Status Code: 0x2 00:23:55.416 Status Code Type: 0x0 00:23:55.416 Do Not Retry: 1 00:23:55.416 Error Location: 0x28 00:23:55.416 LBA: 0x0 00:23:55.416 Namespace: 0x0 00:23:55.416 Vendor Log Page: 0x0 00:23:55.416 00:23:55.416 Number of Queues 00:23:55.416 ================ 00:23:55.416 Number of I/O Submission Queues: 128 00:23:55.416 Number of I/O Completion Queues: 128 00:23:55.416 00:23:55.416 ZNS Specific Controller Data 00:23:55.416 ============================ 00:23:55.416 Zone Append Size Limit: 0 00:23:55.416 00:23:55.416 00:23:55.416 Active Namespaces 00:23:55.416 ================= 00:23:55.416 get_feature(0x05) failed 00:23:55.416 Namespace ID:1 00:23:55.416 Command Set Identifier: NVM (00h) 00:23:55.416 Deallocate: Supported 00:23:55.416 Deallocated/Unwritten Error: Not Supported 00:23:55.416 Deallocated Read Value: Unknown 00:23:55.416 Deallocate in Write Zeroes: Not Supported 00:23:55.416 Deallocated Guard Field: 0xFFFF 00:23:55.416 Flush: Supported 00:23:55.416 Reservation: Not Supported 00:23:55.416 Namespace Sharing Capabilities: Multiple Controllers 00:23:55.416 Size (in LBAs): 3750748848 (1788GiB) 00:23:55.416 Capacity (in LBAs): 3750748848 (1788GiB) 00:23:55.416 Utilization (in LBAs): 3750748848 (1788GiB) 00:23:55.416 UUID: 0a2c66d3-ad79-4365-b688-d2e3c0e62a5d 00:23:55.416 Thin Provisioning: Not Supported 00:23:55.416 Per-NS Atomic Units: Yes 00:23:55.416 Atomic Write Unit (Normal): 8 00:23:55.416 Atomic Write Unit (PFail): 8 00:23:55.416 Preferred Write Granularity: 8 00:23:55.416 Atomic Compare & Write Unit: 8 00:23:55.416 Atomic Boundary Size (Normal): 0 00:23:55.416 Atomic Boundary Size (PFail): 0 00:23:55.416 Atomic Boundary Offset: 0 00:23:55.416 NGUID/EUI64 Never Reused: No 00:23:55.416 ANA group ID: 1 00:23:55.416 Namespace Write Protected: No 00:23:55.416 Number of LBA Formats: 1 00:23:55.416 Current LBA Format: LBA Format #00 00:23:55.416 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:55.416 00:23:55.416 15:11:36 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:23:55.416 15:11:36 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:55.416 15:11:36 -- nvmf/common.sh@117 -- # sync 00:23:55.416 15:11:36 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:55.416 15:11:36 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:55.416 15:11:36 -- nvmf/common.sh@120 -- # set +e 00:23:55.416 15:11:36 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:55.416 15:11:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:55.416 rmmod nvme_rdma 00:23:55.416 rmmod nvme_fabrics 00:23:55.416 15:11:36 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:55.416 15:11:36 -- nvmf/common.sh@124 -- # set -e 00:23:55.416 15:11:36 -- nvmf/common.sh@125 -- # return 0 00:23:55.416 15:11:36 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:23:55.416 15:11:36 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:55.416 15:11:36 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:55.416 15:11:36 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:23:55.416 15:11:36 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:23:55.416 15:11:36 -- nvmf/common.sh@675 -- # echo 0 00:23:55.416 15:11:36 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:55.416 15:11:36 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:23:55.416 15:11:36 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:23:55.416 15:11:36 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:23:55.416 15:11:36 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:23:55.416 15:11:36 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:23:55.416 15:11:36 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:23:58.720 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:23:58.720 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:23:58.981 00:23:58.981 real 0m15.477s 00:23:58.981 user 0m4.643s 00:23:58.981 sys 0m9.865s 00:23:58.981 15:11:39 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:58.981 15:11:39 -- common/autotest_common.sh@10 -- # set +x 00:23:58.981 ************************************ 00:23:58.981 END TEST nvmf_identify_kernel_target 00:23:58.981 ************************************ 00:23:58.981 15:11:39 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:23:58.981 15:11:39 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:58.981 15:11:39 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:58.981 15:11:39 -- common/autotest_common.sh@10 -- # set +x 00:23:58.981 ************************************ 00:23:58.981 START TEST nvmf_auth 00:23:58.981 ************************************ 00:23:58.981 15:11:39 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:23:59.242 * Looking for test storage... 00:23:59.242 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:23:59.242 15:11:40 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:59.242 15:11:40 -- nvmf/common.sh@7 -- # uname -s 00:23:59.242 15:11:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:59.242 15:11:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:59.242 15:11:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:59.242 15:11:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:59.242 15:11:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:59.242 15:11:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:59.242 15:11:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:59.242 15:11:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:59.242 15:11:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:59.242 15:11:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:59.242 15:11:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:59.242 15:11:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:23:59.242 15:11:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:59.242 15:11:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:59.242 15:11:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:59.242 15:11:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:59.242 15:11:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:59.242 15:11:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:59.242 15:11:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:59.242 15:11:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:59.242 15:11:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.242 15:11:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.242 15:11:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.242 15:11:40 -- paths/export.sh@5 -- # export PATH 00:23:59.242 15:11:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.242 15:11:40 -- nvmf/common.sh@47 -- # : 0 00:23:59.242 15:11:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:59.242 15:11:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:59.242 15:11:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:59.242 15:11:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:59.242 15:11:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:59.242 15:11:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:59.242 15:11:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:59.242 15:11:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:59.242 15:11:40 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:23:59.242 15:11:40 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:23:59.242 15:11:40 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:23:59.242 15:11:40 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:23:59.242 15:11:40 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:23:59.242 15:11:40 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:23:59.242 15:11:40 -- host/auth.sh@21 -- # keys=() 00:23:59.242 15:11:40 -- host/auth.sh@77 -- # nvmftestinit 00:23:59.242 15:11:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:59.242 15:11:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:59.242 15:11:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:59.242 15:11:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:59.242 15:11:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:59.242 15:11:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:59.242 15:11:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:59.242 15:11:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:59.242 15:11:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:59.242 15:11:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:59.242 15:11:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:59.242 15:11:40 -- common/autotest_common.sh@10 -- # set +x 00:24:07.507 15:11:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:07.507 15:11:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:24:07.507 15:11:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:24:07.507 15:11:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:24:07.507 15:11:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:24:07.507 15:11:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:24:07.507 15:11:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:24:07.507 15:11:46 -- nvmf/common.sh@295 -- # net_devs=() 00:24:07.507 15:11:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:24:07.507 15:11:46 -- nvmf/common.sh@296 -- # e810=() 00:24:07.507 15:11:46 -- nvmf/common.sh@296 -- # local -ga e810 00:24:07.507 15:11:46 -- nvmf/common.sh@297 -- # x722=() 00:24:07.507 15:11:46 -- nvmf/common.sh@297 -- # local -ga x722 00:24:07.507 15:11:46 -- nvmf/common.sh@298 -- # mlx=() 00:24:07.507 15:11:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:24:07.507 15:11:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:07.507 15:11:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:24:07.507 15:11:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:24:07.507 15:11:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:24:07.507 15:11:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:24:07.507 15:11:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:24:07.507 15:11:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:07.507 15:11:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:24:07.507 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:24:07.507 15:11:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:07.507 15:11:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:24:07.507 15:11:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:24:07.507 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:24:07.507 15:11:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:24:07.507 15:11:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:24:07.507 15:11:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:24:07.507 15:11:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:07.507 15:11:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:07.507 15:11:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:07.507 15:11:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:07.507 15:11:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:24:07.507 Found net devices under 0000:31:00.0: mlx_0_0 00:24:07.507 15:11:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:07.507 15:11:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:24:07.507 15:11:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:07.507 15:11:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:24:07.507 15:11:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:07.507 15:11:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:24:07.507 Found net devices under 0000:31:00.1: mlx_0_1 00:24:07.508 15:11:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:24:07.508 15:11:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:24:07.508 15:11:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:24:07.508 15:11:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:24:07.508 15:11:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:24:07.508 15:11:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:24:07.508 15:11:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:24:07.508 15:11:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:24:07.508 15:11:46 -- nvmf/common.sh@58 -- # uname 00:24:07.508 15:11:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:24:07.508 15:11:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:24:07.508 15:11:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:24:07.508 15:11:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:24:07.508 15:11:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:24:07.508 15:11:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:24:07.508 15:11:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:24:07.508 15:11:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:24:07.508 15:11:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:24:07.508 15:11:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:24:07.508 15:11:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:24:07.508 15:11:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:07.508 15:11:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:07.508 15:11:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:07.508 15:11:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:07.508 15:11:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:07.508 15:11:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@105 -- # continue 2 00:24:07.508 15:11:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@105 -- # continue 2 00:24:07.508 15:11:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:07.508 15:11:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:07.508 15:11:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:24:07.508 15:11:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:24:07.508 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:07.508 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:24:07.508 altname enp49s0f0np0 00:24:07.508 altname ens786f0np0 00:24:07.508 inet 192.168.100.8/24 scope global mlx_0_0 00:24:07.508 valid_lft forever preferred_lft forever 00:24:07.508 15:11:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:24:07.508 15:11:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:07.508 15:11:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:24:07.508 15:11:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:24:07.508 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:24:07.508 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:24:07.508 altname enp49s0f1np1 00:24:07.508 altname ens786f1np1 00:24:07.508 inet 192.168.100.9/24 scope global mlx_0_1 00:24:07.508 valid_lft forever preferred_lft forever 00:24:07.508 15:11:47 -- nvmf/common.sh@411 -- # return 0 00:24:07.508 15:11:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:24:07.508 15:11:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:24:07.508 15:11:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:24:07.508 15:11:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:24:07.508 15:11:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:07.508 15:11:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:07.508 15:11:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:07.508 15:11:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:07.508 15:11:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:07.508 15:11:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@105 -- # continue 2 00:24:07.508 15:11:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:07.508 15:11:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:07.508 15:11:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@105 -- # continue 2 00:24:07.508 15:11:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:07.508 15:11:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:07.508 15:11:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:24:07.508 15:11:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:07.508 15:11:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:07.508 15:11:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:24:07.508 192.168.100.9' 00:24:07.508 15:11:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:24:07.508 192.168.100.9' 00:24:07.508 15:11:47 -- nvmf/common.sh@446 -- # head -n 1 00:24:07.508 15:11:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:24:07.508 15:11:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:24:07.508 192.168.100.9' 00:24:07.508 15:11:47 -- nvmf/common.sh@447 -- # tail -n +2 00:24:07.508 15:11:47 -- nvmf/common.sh@447 -- # head -n 1 00:24:07.508 15:11:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:24:07.508 15:11:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:24:07.508 15:11:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:24:07.508 15:11:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:24:07.508 15:11:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:24:07.508 15:11:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:24:07.508 15:11:47 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:24:07.508 15:11:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:07.508 15:11:47 -- common/autotest_common.sh@720 -- # xtrace_disable 00:24:07.508 15:11:47 -- common/autotest_common.sh@10 -- # set +x 00:24:07.508 15:11:47 -- nvmf/common.sh@470 -- # nvmfpid=3634610 00:24:07.508 15:11:47 -- nvmf/common.sh@471 -- # waitforlisten 3634610 00:24:07.508 15:11:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:24:07.508 15:11:47 -- common/autotest_common.sh@827 -- # '[' -z 3634610 ']' 00:24:07.508 15:11:47 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:07.508 15:11:47 -- common/autotest_common.sh@832 -- # local max_retries=100 00:24:07.508 15:11:47 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:07.508 15:11:47 -- common/autotest_common.sh@836 -- # xtrace_disable 00:24:07.508 15:11:47 -- common/autotest_common.sh@10 -- # set +x 00:24:07.508 15:11:48 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:24:07.508 15:11:48 -- common/autotest_common.sh@860 -- # return 0 00:24:07.508 15:11:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:07.508 15:11:48 -- common/autotest_common.sh@726 -- # xtrace_disable 00:24:07.508 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.508 15:11:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:07.508 15:11:48 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:24:07.508 15:11:48 -- host/auth.sh@81 -- # gen_key null 32 00:24:07.508 15:11:48 -- host/auth.sh@53 -- # local digest len file key 00:24:07.508 15:11:48 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:24:07.508 15:11:48 -- host/auth.sh@54 -- # local -A digests 00:24:07.508 15:11:48 -- host/auth.sh@56 -- # digest=null 00:24:07.508 15:11:48 -- host/auth.sh@56 -- # len=32 00:24:07.508 15:11:48 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:24:07.508 15:11:48 -- host/auth.sh@57 -- # key=c2f6e63cb88dc2612338fd5cd83fa5f2 00:24:07.508 15:11:48 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:24:07.508 15:11:48 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.xnE 00:24:07.508 15:11:48 -- host/auth.sh@59 -- # format_dhchap_key c2f6e63cb88dc2612338fd5cd83fa5f2 0 00:24:07.508 15:11:48 -- nvmf/common.sh@708 -- # format_key DHHC-1 c2f6e63cb88dc2612338fd5cd83fa5f2 0 00:24:07.508 15:11:48 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:07.508 15:11:48 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:24:07.508 15:11:48 -- nvmf/common.sh@693 -- # key=c2f6e63cb88dc2612338fd5cd83fa5f2 00:24:07.508 15:11:48 -- nvmf/common.sh@693 -- # digest=0 00:24:07.508 15:11:48 -- nvmf/common.sh@694 -- # python - 00:24:07.508 15:11:48 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.xnE 00:24:07.508 15:11:48 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.xnE 00:24:07.508 15:11:48 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.xnE 00:24:07.509 15:11:48 -- host/auth.sh@82 -- # gen_key null 48 00:24:07.509 15:11:48 -- host/auth.sh@53 -- # local digest len file key 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # local -A digests 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # digest=null 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # len=48 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # key=4ab5f25e7a37c16c77fa76a9ee10d3e022293f7a21b887db 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.JUv 00:24:07.509 15:11:48 -- host/auth.sh@59 -- # format_dhchap_key 4ab5f25e7a37c16c77fa76a9ee10d3e022293f7a21b887db 0 00:24:07.509 15:11:48 -- nvmf/common.sh@708 -- # format_key DHHC-1 4ab5f25e7a37c16c77fa76a9ee10d3e022293f7a21b887db 0 00:24:07.509 15:11:48 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # key=4ab5f25e7a37c16c77fa76a9ee10d3e022293f7a21b887db 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # digest=0 00:24:07.509 15:11:48 -- nvmf/common.sh@694 -- # python - 00:24:07.509 15:11:48 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.JUv 00:24:07.509 15:11:48 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.JUv 00:24:07.509 15:11:48 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.JUv 00:24:07.509 15:11:48 -- host/auth.sh@83 -- # gen_key sha256 32 00:24:07.509 15:11:48 -- host/auth.sh@53 -- # local digest len file key 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # local -A digests 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # digest=sha256 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # len=32 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # key=bba5d912939c9aded4b1ba8ef2d0b179 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.OOC 00:24:07.509 15:11:48 -- host/auth.sh@59 -- # format_dhchap_key bba5d912939c9aded4b1ba8ef2d0b179 1 00:24:07.509 15:11:48 -- nvmf/common.sh@708 -- # format_key DHHC-1 bba5d912939c9aded4b1ba8ef2d0b179 1 00:24:07.509 15:11:48 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # key=bba5d912939c9aded4b1ba8ef2d0b179 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # digest=1 00:24:07.509 15:11:48 -- nvmf/common.sh@694 -- # python - 00:24:07.509 15:11:48 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.OOC 00:24:07.509 15:11:48 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.OOC 00:24:07.509 15:11:48 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.OOC 00:24:07.509 15:11:48 -- host/auth.sh@84 -- # gen_key sha384 48 00:24:07.509 15:11:48 -- host/auth.sh@53 -- # local digest len file key 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # local -A digests 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # digest=sha384 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # len=48 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # key=53b44acc541ae028ea69284a9b5f1c1d66569232688f2ef2 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.VdI 00:24:07.509 15:11:48 -- host/auth.sh@59 -- # format_dhchap_key 53b44acc541ae028ea69284a9b5f1c1d66569232688f2ef2 2 00:24:07.509 15:11:48 -- nvmf/common.sh@708 -- # format_key DHHC-1 53b44acc541ae028ea69284a9b5f1c1d66569232688f2ef2 2 00:24:07.509 15:11:48 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # key=53b44acc541ae028ea69284a9b5f1c1d66569232688f2ef2 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # digest=2 00:24:07.509 15:11:48 -- nvmf/common.sh@694 -- # python - 00:24:07.509 15:11:48 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.VdI 00:24:07.509 15:11:48 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.VdI 00:24:07.509 15:11:48 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.VdI 00:24:07.509 15:11:48 -- host/auth.sh@85 -- # gen_key sha512 64 00:24:07.509 15:11:48 -- host/auth.sh@53 -- # local digest len file key 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:24:07.509 15:11:48 -- host/auth.sh@54 -- # local -A digests 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # digest=sha512 00:24:07.509 15:11:48 -- host/auth.sh@56 -- # len=64 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:24:07.509 15:11:48 -- host/auth.sh@57 -- # key=dc4ac24d38c93dd9f5dd6b3ea12711ba2646bc4bf8aac70f38d5b708986c76f1 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:24:07.509 15:11:48 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.hwA 00:24:07.509 15:11:48 -- host/auth.sh@59 -- # format_dhchap_key dc4ac24d38c93dd9f5dd6b3ea12711ba2646bc4bf8aac70f38d5b708986c76f1 3 00:24:07.509 15:11:48 -- nvmf/common.sh@708 -- # format_key DHHC-1 dc4ac24d38c93dd9f5dd6b3ea12711ba2646bc4bf8aac70f38d5b708986c76f1 3 00:24:07.509 15:11:48 -- nvmf/common.sh@691 -- # local prefix key digest 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # key=dc4ac24d38c93dd9f5dd6b3ea12711ba2646bc4bf8aac70f38d5b708986c76f1 00:24:07.509 15:11:48 -- nvmf/common.sh@693 -- # digest=3 00:24:07.509 15:11:48 -- nvmf/common.sh@694 -- # python - 00:24:07.509 15:11:48 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.hwA 00:24:07.509 15:11:48 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.hwA 00:24:07.509 15:11:48 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.hwA 00:24:07.509 15:11:48 -- host/auth.sh@87 -- # waitforlisten 3634610 00:24:07.509 15:11:48 -- common/autotest_common.sh@827 -- # '[' -z 3634610 ']' 00:24:07.509 15:11:48 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:07.509 15:11:48 -- common/autotest_common.sh@832 -- # local max_retries=100 00:24:07.509 15:11:48 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:07.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:07.509 15:11:48 -- common/autotest_common.sh@836 -- # xtrace_disable 00:24:07.509 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:24:07.771 15:11:48 -- common/autotest_common.sh@860 -- # return 0 00:24:07.771 15:11:48 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:24:07.771 15:11:48 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.xnE 00:24:07.771 15:11:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:07.771 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:07.771 15:11:48 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:24:07.771 15:11:48 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.JUv 00:24:07.771 15:11:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:07.771 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:07.771 15:11:48 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:24:07.771 15:11:48 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.OOC 00:24:07.771 15:11:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:07.771 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:07.771 15:11:48 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:24:07.771 15:11:48 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.VdI 00:24:07.771 15:11:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:07.771 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:07.771 15:11:48 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:24:07.771 15:11:48 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.hwA 00:24:07.771 15:11:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:07.771 15:11:48 -- common/autotest_common.sh@10 -- # set +x 00:24:07.771 15:11:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:07.771 15:11:48 -- host/auth.sh@92 -- # nvmet_auth_init 00:24:07.771 15:11:48 -- host/auth.sh@35 -- # get_main_ns_ip 00:24:07.771 15:11:48 -- nvmf/common.sh@717 -- # local ip 00:24:07.771 15:11:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:07.771 15:11:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:07.771 15:11:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:07.771 15:11:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:07.771 15:11:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:07.771 15:11:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:07.771 15:11:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:07.771 15:11:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:07.771 15:11:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:07.771 15:11:48 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:24:07.771 15:11:48 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:24:07.771 15:11:48 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:24:07.771 15:11:48 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:24:07.771 15:11:48 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:24:07.771 15:11:48 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:24:07.771 15:11:48 -- nvmf/common.sh@628 -- # local block nvme 00:24:07.771 15:11:48 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:24:07.771 15:11:48 -- nvmf/common.sh@631 -- # modprobe nvmet 00:24:07.771 15:11:48 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:24:07.772 15:11:48 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:24:11.071 Waiting for block devices as requested 00:24:11.071 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:24:11.071 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:24:11.333 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:24:11.333 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:24:11.333 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:24:11.594 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:24:11.594 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:24:11.594 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:24:11.854 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:24:11.854 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:24:11.854 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:24:12.115 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:24:12.115 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:24:12.115 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:24:12.115 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:24:12.376 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:24:12.376 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:24:12.946 15:11:53 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:24:12.946 15:11:53 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:24:12.946 15:11:53 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:24:12.946 15:11:53 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:24:12.946 15:11:53 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:24:12.946 15:11:53 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:24:12.946 15:11:53 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:24:12.946 15:11:53 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:24:12.946 15:11:53 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:24:12.946 No valid GPT data, bailing 00:24:12.946 15:11:53 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:24:13.208 15:11:53 -- scripts/common.sh@391 -- # pt= 00:24:13.208 15:11:53 -- scripts/common.sh@392 -- # return 1 00:24:13.208 15:11:53 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:24:13.208 15:11:53 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:24:13.208 15:11:53 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:24:13.208 15:11:53 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:24:13.208 15:11:53 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:24:13.208 15:11:53 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:24:13.208 15:11:53 -- nvmf/common.sh@656 -- # echo 1 00:24:13.208 15:11:53 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:24:13.208 15:11:53 -- nvmf/common.sh@658 -- # echo 1 00:24:13.208 15:11:53 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:24:13.208 15:11:53 -- nvmf/common.sh@661 -- # echo rdma 00:24:13.208 15:11:53 -- nvmf/common.sh@662 -- # echo 4420 00:24:13.208 15:11:53 -- nvmf/common.sh@663 -- # echo ipv4 00:24:13.208 15:11:53 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:24:13.208 15:11:53 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be --hostid=00d0226a-fbea-ec11-9bc7-a4bf019282be -a 192.168.100.8 -t rdma -s 4420 00:24:13.208 00:24:13.208 Discovery Log Number of Records 2, Generation counter 2 00:24:13.208 =====Discovery Log Entry 0====== 00:24:13.208 trtype: rdma 00:24:13.208 adrfam: ipv4 00:24:13.208 subtype: current discovery subsystem 00:24:13.208 treq: not specified, sq flow control disable supported 00:24:13.208 portid: 1 00:24:13.208 trsvcid: 4420 00:24:13.208 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:24:13.208 traddr: 192.168.100.8 00:24:13.208 eflags: none 00:24:13.208 rdma_prtype: not specified 00:24:13.208 rdma_qptype: connected 00:24:13.208 rdma_cms: rdma-cm 00:24:13.208 rdma_pkey: 0x0000 00:24:13.208 =====Discovery Log Entry 1====== 00:24:13.208 trtype: rdma 00:24:13.208 adrfam: ipv4 00:24:13.208 subtype: nvme subsystem 00:24:13.208 treq: not specified, sq flow control disable supported 00:24:13.208 portid: 1 00:24:13.208 trsvcid: 4420 00:24:13.208 subnqn: nqn.2024-02.io.spdk:cnode0 00:24:13.208 traddr: 192.168.100.8 00:24:13.208 eflags: none 00:24:13.208 rdma_prtype: not specified 00:24:13.208 rdma_qptype: connected 00:24:13.208 rdma_cms: rdma-cm 00:24:13.208 rdma_pkey: 0x0000 00:24:13.208 15:11:54 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:24:13.208 15:11:54 -- host/auth.sh@37 -- # echo 0 00:24:13.208 15:11:54 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:24:13.208 15:11:54 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:24:13.208 15:11:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:13.208 15:11:54 -- host/auth.sh@44 -- # digest=sha256 00:24:13.208 15:11:54 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:13.208 15:11:54 -- host/auth.sh@44 -- # keyid=1 00:24:13.208 15:11:54 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:13.208 15:11:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:13.208 15:11:54 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:13.208 15:11:54 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:13.208 15:11:54 -- host/auth.sh@100 -- # IFS=, 00:24:13.208 15:11:54 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:24:13.208 15:11:54 -- host/auth.sh@100 -- # IFS=, 00:24:13.208 15:11:54 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:24:13.208 15:11:54 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:24:13.208 15:11:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:13.208 15:11:54 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:24:13.208 15:11:54 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:24:13.208 15:11:54 -- host/auth.sh@68 -- # keyid=1 00:24:13.208 15:11:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:24:13.208 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.208 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.209 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.209 15:11:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:13.209 15:11:54 -- nvmf/common.sh@717 -- # local ip 00:24:13.209 15:11:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:13.209 15:11:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:13.209 15:11:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:13.209 15:11:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:13.209 15:11:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:13.209 15:11:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:13.209 15:11:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:13.209 15:11:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:13.209 15:11:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:13.209 15:11:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:13.209 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.209 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.469 nvme0n1 00:24:13.469 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.469 15:11:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:13.469 15:11:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:13.469 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.469 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.469 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.469 15:11:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:13.469 15:11:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:13.469 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.469 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.470 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.470 15:11:54 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:24:13.470 15:11:54 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:13.470 15:11:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:13.470 15:11:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:24:13.470 15:11:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:13.470 15:11:54 -- host/auth.sh@44 -- # digest=sha256 00:24:13.470 15:11:54 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:13.470 15:11:54 -- host/auth.sh@44 -- # keyid=0 00:24:13.470 15:11:54 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:13.470 15:11:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:13.470 15:11:54 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:13.470 15:11:54 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:13.470 15:11:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:24:13.470 15:11:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:13.470 15:11:54 -- host/auth.sh@68 -- # digest=sha256 00:24:13.470 15:11:54 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:13.470 15:11:54 -- host/auth.sh@68 -- # keyid=0 00:24:13.470 15:11:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:13.470 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.470 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.470 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.470 15:11:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:13.470 15:11:54 -- nvmf/common.sh@717 -- # local ip 00:24:13.470 15:11:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:13.470 15:11:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:13.470 15:11:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:13.470 15:11:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:13.470 15:11:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:13.470 15:11:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:13.470 15:11:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:13.470 15:11:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:13.470 15:11:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:13.470 15:11:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:13.470 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.470 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.732 nvme0n1 00:24:13.732 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.732 15:11:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:13.732 15:11:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:13.732 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.732 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.732 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.732 15:11:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:13.732 15:11:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:13.732 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.732 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.732 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.732 15:11:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:13.732 15:11:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:24:13.732 15:11:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:13.732 15:11:54 -- host/auth.sh@44 -- # digest=sha256 00:24:13.732 15:11:54 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:13.732 15:11:54 -- host/auth.sh@44 -- # keyid=1 00:24:13.732 15:11:54 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:13.732 15:11:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:13.732 15:11:54 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:13.732 15:11:54 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:13.732 15:11:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:24:13.732 15:11:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:13.732 15:11:54 -- host/auth.sh@68 -- # digest=sha256 00:24:13.732 15:11:54 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:13.732 15:11:54 -- host/auth.sh@68 -- # keyid=1 00:24:13.732 15:11:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:13.732 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.732 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.732 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.732 15:11:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:13.732 15:11:54 -- nvmf/common.sh@717 -- # local ip 00:24:13.732 15:11:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:13.732 15:11:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:13.732 15:11:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:13.732 15:11:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:13.732 15:11:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:13.732 15:11:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:13.732 15:11:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:13.732 15:11:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:13.732 15:11:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:13.732 15:11:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:13.732 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.732 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.994 nvme0n1 00:24:13.994 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.994 15:11:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:13.994 15:11:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:13.994 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.994 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.994 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.994 15:11:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:13.994 15:11:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:13.994 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.994 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.994 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.994 15:11:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:13.994 15:11:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:24:13.994 15:11:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:13.994 15:11:54 -- host/auth.sh@44 -- # digest=sha256 00:24:13.994 15:11:54 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:13.994 15:11:54 -- host/auth.sh@44 -- # keyid=2 00:24:13.994 15:11:54 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:13.994 15:11:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:13.994 15:11:54 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:13.994 15:11:54 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:13.994 15:11:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:24:13.994 15:11:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:13.994 15:11:54 -- host/auth.sh@68 -- # digest=sha256 00:24:13.994 15:11:54 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:13.994 15:11:54 -- host/auth.sh@68 -- # keyid=2 00:24:13.994 15:11:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:13.994 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.994 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:13.994 15:11:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:13.994 15:11:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:13.994 15:11:54 -- nvmf/common.sh@717 -- # local ip 00:24:13.994 15:11:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:13.994 15:11:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:13.994 15:11:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:13.994 15:11:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:13.994 15:11:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:13.994 15:11:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:13.994 15:11:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:13.994 15:11:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:13.994 15:11:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:13.994 15:11:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:13.994 15:11:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:13.994 15:11:54 -- common/autotest_common.sh@10 -- # set +x 00:24:14.255 nvme0n1 00:24:14.255 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.255 15:11:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:14.255 15:11:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:14.255 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.255 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.255 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.255 15:11:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:14.255 15:11:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:14.255 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.255 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.517 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.517 15:11:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:14.517 15:11:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:24:14.517 15:11:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:14.517 15:11:55 -- host/auth.sh@44 -- # digest=sha256 00:24:14.517 15:11:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:14.517 15:11:55 -- host/auth.sh@44 -- # keyid=3 00:24:14.517 15:11:55 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:14.517 15:11:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:14.517 15:11:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:14.517 15:11:55 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:14.517 15:11:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:24:14.517 15:11:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:14.517 15:11:55 -- host/auth.sh@68 -- # digest=sha256 00:24:14.517 15:11:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:14.517 15:11:55 -- host/auth.sh@68 -- # keyid=3 00:24:14.517 15:11:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:14.517 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.517 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.517 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.517 15:11:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:14.517 15:11:55 -- nvmf/common.sh@717 -- # local ip 00:24:14.517 15:11:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:14.517 15:11:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:14.517 15:11:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:14.517 15:11:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:14.517 15:11:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:14.517 15:11:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:14.517 15:11:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:14.517 15:11:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:14.517 15:11:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:14.517 15:11:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:14.517 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.517 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.517 nvme0n1 00:24:14.517 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.517 15:11:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:14.517 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.517 15:11:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:14.517 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.517 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.778 15:11:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:14.778 15:11:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:14.778 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.778 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.778 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.778 15:11:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:14.778 15:11:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:24:14.778 15:11:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:14.778 15:11:55 -- host/auth.sh@44 -- # digest=sha256 00:24:14.778 15:11:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:14.778 15:11:55 -- host/auth.sh@44 -- # keyid=4 00:24:14.778 15:11:55 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:14.778 15:11:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:14.778 15:11:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:14.778 15:11:55 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:14.778 15:11:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:24:14.778 15:11:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:14.778 15:11:55 -- host/auth.sh@68 -- # digest=sha256 00:24:14.778 15:11:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:14.778 15:11:55 -- host/auth.sh@68 -- # keyid=4 00:24:14.778 15:11:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:14.778 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.778 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.778 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.778 15:11:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:14.778 15:11:55 -- nvmf/common.sh@717 -- # local ip 00:24:14.778 15:11:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:14.778 15:11:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:14.778 15:11:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:14.778 15:11:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:14.778 15:11:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:14.778 15:11:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:14.778 15:11:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:14.778 15:11:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:14.778 15:11:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:14.778 15:11:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:14.778 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.778 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:14.778 nvme0n1 00:24:14.778 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:14.778 15:11:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:14.778 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:14.778 15:11:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:14.778 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:15.038 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.038 15:11:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:15.039 15:11:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:15.039 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.039 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:15.039 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.039 15:11:55 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:15.039 15:11:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:15.039 15:11:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:24:15.039 15:11:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:15.039 15:11:55 -- host/auth.sh@44 -- # digest=sha256 00:24:15.039 15:11:55 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:15.039 15:11:55 -- host/auth.sh@44 -- # keyid=0 00:24:15.039 15:11:55 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:15.039 15:11:55 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:15.039 15:11:55 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:15.039 15:11:55 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:15.039 15:11:55 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:24:15.039 15:11:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:15.039 15:11:55 -- host/auth.sh@68 -- # digest=sha256 00:24:15.039 15:11:55 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:15.039 15:11:55 -- host/auth.sh@68 -- # keyid=0 00:24:15.039 15:11:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:24:15.039 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.039 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:15.039 15:11:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.039 15:11:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:15.039 15:11:55 -- nvmf/common.sh@717 -- # local ip 00:24:15.039 15:11:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:15.039 15:11:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:15.039 15:11:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:15.039 15:11:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:15.039 15:11:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:15.039 15:11:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:15.039 15:11:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:15.039 15:11:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:15.039 15:11:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:15.039 15:11:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:15.039 15:11:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.039 15:11:55 -- common/autotest_common.sh@10 -- # set +x 00:24:15.300 nvme0n1 00:24:15.300 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.300 15:11:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:15.300 15:11:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:15.300 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.300 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.300 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.300 15:11:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:15.300 15:11:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:15.300 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.300 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.300 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.300 15:11:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:15.300 15:11:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:24:15.300 15:11:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:15.300 15:11:56 -- host/auth.sh@44 -- # digest=sha256 00:24:15.300 15:11:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:15.300 15:11:56 -- host/auth.sh@44 -- # keyid=1 00:24:15.300 15:11:56 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:15.300 15:11:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:15.300 15:11:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:15.300 15:11:56 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:15.300 15:11:56 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:24:15.300 15:11:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:15.300 15:11:56 -- host/auth.sh@68 -- # digest=sha256 00:24:15.300 15:11:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:15.300 15:11:56 -- host/auth.sh@68 -- # keyid=1 00:24:15.300 15:11:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:24:15.300 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.300 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.300 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.300 15:11:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:15.300 15:11:56 -- nvmf/common.sh@717 -- # local ip 00:24:15.301 15:11:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:15.301 15:11:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:15.301 15:11:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:15.301 15:11:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:15.301 15:11:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:15.301 15:11:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:15.301 15:11:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:15.301 15:11:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:15.301 15:11:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:15.301 15:11:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:15.301 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.301 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.562 nvme0n1 00:24:15.562 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.562 15:11:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:15.562 15:11:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:15.562 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.562 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.562 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.562 15:11:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:15.562 15:11:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:15.562 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.562 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.562 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.562 15:11:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:15.562 15:11:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:24:15.562 15:11:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:15.562 15:11:56 -- host/auth.sh@44 -- # digest=sha256 00:24:15.562 15:11:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:15.562 15:11:56 -- host/auth.sh@44 -- # keyid=2 00:24:15.562 15:11:56 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:15.562 15:11:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:15.562 15:11:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:15.562 15:11:56 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:15.562 15:11:56 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:24:15.562 15:11:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:15.562 15:11:56 -- host/auth.sh@68 -- # digest=sha256 00:24:15.562 15:11:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:15.562 15:11:56 -- host/auth.sh@68 -- # keyid=2 00:24:15.562 15:11:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:24:15.562 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.562 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.562 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.562 15:11:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:15.562 15:11:56 -- nvmf/common.sh@717 -- # local ip 00:24:15.562 15:11:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:15.562 15:11:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:15.562 15:11:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:15.562 15:11:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:15.562 15:11:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:15.562 15:11:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:15.562 15:11:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:15.562 15:11:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:15.562 15:11:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:15.562 15:11:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:15.562 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.562 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.823 nvme0n1 00:24:15.823 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.823 15:11:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:15.823 15:11:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:15.823 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.823 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.823 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.823 15:11:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:15.823 15:11:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:15.823 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.823 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.823 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.823 15:11:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:15.823 15:11:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:24:15.823 15:11:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:15.823 15:11:56 -- host/auth.sh@44 -- # digest=sha256 00:24:15.823 15:11:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:15.823 15:11:56 -- host/auth.sh@44 -- # keyid=3 00:24:15.823 15:11:56 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:15.823 15:11:56 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:15.823 15:11:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:15.823 15:11:56 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:15.823 15:11:56 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:24:15.823 15:11:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:15.823 15:11:56 -- host/auth.sh@68 -- # digest=sha256 00:24:15.823 15:11:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:15.823 15:11:56 -- host/auth.sh@68 -- # keyid=3 00:24:15.823 15:11:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:24:15.823 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.823 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:15.823 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:15.823 15:11:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:15.823 15:11:56 -- nvmf/common.sh@717 -- # local ip 00:24:15.823 15:11:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:15.823 15:11:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:15.823 15:11:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:15.823 15:11:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:15.823 15:11:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:15.823 15:11:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:15.823 15:11:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:15.823 15:11:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:15.823 15:11:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:15.823 15:11:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:15.823 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:15.823 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:16.085 nvme0n1 00:24:16.085 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.085 15:11:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:16.085 15:11:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:16.085 15:11:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.085 15:11:56 -- common/autotest_common.sh@10 -- # set +x 00:24:16.085 15:11:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.085 15:11:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:16.085 15:11:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:16.085 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.085 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.345 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.345 15:11:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:16.345 15:11:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:24:16.345 15:11:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:16.345 15:11:57 -- host/auth.sh@44 -- # digest=sha256 00:24:16.345 15:11:57 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:16.345 15:11:57 -- host/auth.sh@44 -- # keyid=4 00:24:16.346 15:11:57 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:16.346 15:11:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:16.346 15:11:57 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:16.346 15:11:57 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:16.346 15:11:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:24:16.346 15:11:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:16.346 15:11:57 -- host/auth.sh@68 -- # digest=sha256 00:24:16.346 15:11:57 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:16.346 15:11:57 -- host/auth.sh@68 -- # keyid=4 00:24:16.346 15:11:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:24:16.346 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.346 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.346 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.346 15:11:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:16.346 15:11:57 -- nvmf/common.sh@717 -- # local ip 00:24:16.346 15:11:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:16.346 15:11:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:16.346 15:11:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:16.346 15:11:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:16.346 15:11:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:16.346 15:11:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:16.346 15:11:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:16.346 15:11:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:16.346 15:11:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:16.346 15:11:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:16.346 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.346 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.346 nvme0n1 00:24:16.346 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.346 15:11:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:16.346 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.346 15:11:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:16.346 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.608 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.608 15:11:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:16.608 15:11:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:16.608 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.608 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.608 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.608 15:11:57 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:16.608 15:11:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:16.608 15:11:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:24:16.608 15:11:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:16.608 15:11:57 -- host/auth.sh@44 -- # digest=sha256 00:24:16.608 15:11:57 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:16.608 15:11:57 -- host/auth.sh@44 -- # keyid=0 00:24:16.608 15:11:57 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:16.608 15:11:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:16.608 15:11:57 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:16.608 15:11:57 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:16.608 15:11:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:24:16.608 15:11:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:16.608 15:11:57 -- host/auth.sh@68 -- # digest=sha256 00:24:16.608 15:11:57 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:16.608 15:11:57 -- host/auth.sh@68 -- # keyid=0 00:24:16.608 15:11:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:24:16.608 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.608 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.608 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.608 15:11:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:16.608 15:11:57 -- nvmf/common.sh@717 -- # local ip 00:24:16.608 15:11:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:16.608 15:11:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:16.608 15:11:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:16.608 15:11:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:16.608 15:11:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:16.608 15:11:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:16.608 15:11:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:16.608 15:11:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:16.608 15:11:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:16.608 15:11:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:16.608 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.608 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.870 nvme0n1 00:24:16.870 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.870 15:11:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:16.870 15:11:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:16.870 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.870 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.870 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.870 15:11:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:16.870 15:11:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:16.870 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.870 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.870 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.870 15:11:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:16.870 15:11:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:24:16.870 15:11:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:16.870 15:11:57 -- host/auth.sh@44 -- # digest=sha256 00:24:16.870 15:11:57 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:16.870 15:11:57 -- host/auth.sh@44 -- # keyid=1 00:24:16.870 15:11:57 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:16.870 15:11:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:16.870 15:11:57 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:16.870 15:11:57 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:16.870 15:11:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:24:16.870 15:11:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:16.870 15:11:57 -- host/auth.sh@68 -- # digest=sha256 00:24:16.870 15:11:57 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:16.870 15:11:57 -- host/auth.sh@68 -- # keyid=1 00:24:16.870 15:11:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:24:16.870 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.870 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:16.870 15:11:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:16.870 15:11:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:16.870 15:11:57 -- nvmf/common.sh@717 -- # local ip 00:24:16.870 15:11:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:16.870 15:11:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:16.870 15:11:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:16.870 15:11:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:16.870 15:11:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:16.870 15:11:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:16.870 15:11:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:16.870 15:11:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:16.870 15:11:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:16.870 15:11:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:16.870 15:11:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:16.870 15:11:57 -- common/autotest_common.sh@10 -- # set +x 00:24:17.132 nvme0n1 00:24:17.132 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.132 15:11:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:17.132 15:11:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:17.132 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.132 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.132 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.400 15:11:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:17.401 15:11:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:17.401 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.401 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.401 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.401 15:11:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:17.401 15:11:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:24:17.401 15:11:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:17.401 15:11:58 -- host/auth.sh@44 -- # digest=sha256 00:24:17.401 15:11:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:17.401 15:11:58 -- host/auth.sh@44 -- # keyid=2 00:24:17.401 15:11:58 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:17.401 15:11:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:17.401 15:11:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:17.401 15:11:58 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:17.401 15:11:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:24:17.401 15:11:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:17.401 15:11:58 -- host/auth.sh@68 -- # digest=sha256 00:24:17.401 15:11:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:17.401 15:11:58 -- host/auth.sh@68 -- # keyid=2 00:24:17.401 15:11:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:24:17.401 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.401 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.401 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.401 15:11:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:17.401 15:11:58 -- nvmf/common.sh@717 -- # local ip 00:24:17.401 15:11:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:17.401 15:11:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:17.401 15:11:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:17.401 15:11:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:17.401 15:11:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:17.401 15:11:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:17.401 15:11:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:17.401 15:11:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:17.401 15:11:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:17.401 15:11:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:17.401 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.401 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.663 nvme0n1 00:24:17.663 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.663 15:11:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:17.663 15:11:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:17.663 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.663 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.663 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.663 15:11:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:17.663 15:11:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:17.663 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.663 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.663 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.663 15:11:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:17.663 15:11:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:24:17.663 15:11:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:17.663 15:11:58 -- host/auth.sh@44 -- # digest=sha256 00:24:17.663 15:11:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:17.663 15:11:58 -- host/auth.sh@44 -- # keyid=3 00:24:17.663 15:11:58 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:17.663 15:11:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:17.663 15:11:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:17.663 15:11:58 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:17.663 15:11:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:24:17.663 15:11:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:17.663 15:11:58 -- host/auth.sh@68 -- # digest=sha256 00:24:17.663 15:11:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:17.663 15:11:58 -- host/auth.sh@68 -- # keyid=3 00:24:17.663 15:11:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:24:17.663 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.663 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.663 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.663 15:11:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:17.663 15:11:58 -- nvmf/common.sh@717 -- # local ip 00:24:17.663 15:11:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:17.663 15:11:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:17.663 15:11:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:17.663 15:11:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:17.663 15:11:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:17.663 15:11:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:17.663 15:11:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:17.663 15:11:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:17.663 15:11:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:17.663 15:11:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:17.663 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.663 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.925 nvme0n1 00:24:17.925 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.925 15:11:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:17.925 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.925 15:11:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:17.925 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:17.925 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:17.925 15:11:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:17.925 15:11:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:17.925 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:17.925 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:18.186 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.186 15:11:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:18.186 15:11:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:24:18.186 15:11:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:18.186 15:11:58 -- host/auth.sh@44 -- # digest=sha256 00:24:18.186 15:11:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:18.186 15:11:58 -- host/auth.sh@44 -- # keyid=4 00:24:18.186 15:11:58 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:18.186 15:11:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:18.186 15:11:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:18.186 15:11:58 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:18.186 15:11:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:24:18.186 15:11:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:18.186 15:11:58 -- host/auth.sh@68 -- # digest=sha256 00:24:18.186 15:11:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:18.186 15:11:58 -- host/auth.sh@68 -- # keyid=4 00:24:18.186 15:11:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:24:18.186 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.186 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:18.186 15:11:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.186 15:11:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:18.186 15:11:58 -- nvmf/common.sh@717 -- # local ip 00:24:18.186 15:11:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:18.186 15:11:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:18.186 15:11:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:18.186 15:11:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:18.186 15:11:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:18.186 15:11:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:18.186 15:11:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:18.187 15:11:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:18.187 15:11:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:18.187 15:11:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:18.187 15:11:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.187 15:11:58 -- common/autotest_common.sh@10 -- # set +x 00:24:18.448 nvme0n1 00:24:18.448 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.448 15:11:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:18.448 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.448 15:11:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:18.448 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:18.448 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.448 15:11:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:18.448 15:11:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:18.448 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.448 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:18.448 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.448 15:11:59 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:18.448 15:11:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:18.448 15:11:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:24:18.448 15:11:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:18.448 15:11:59 -- host/auth.sh@44 -- # digest=sha256 00:24:18.448 15:11:59 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:18.448 15:11:59 -- host/auth.sh@44 -- # keyid=0 00:24:18.448 15:11:59 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:18.448 15:11:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:18.448 15:11:59 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:18.448 15:11:59 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:18.448 15:11:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:24:18.448 15:11:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:18.448 15:11:59 -- host/auth.sh@68 -- # digest=sha256 00:24:18.448 15:11:59 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:18.448 15:11:59 -- host/auth.sh@68 -- # keyid=0 00:24:18.448 15:11:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:24:18.448 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.448 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:18.448 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:18.448 15:11:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:18.448 15:11:59 -- nvmf/common.sh@717 -- # local ip 00:24:18.448 15:11:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:18.448 15:11:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:18.448 15:11:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:18.448 15:11:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:18.448 15:11:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:18.448 15:11:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:18.448 15:11:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:18.448 15:11:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:18.448 15:11:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:18.448 15:11:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:18.448 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:18.448 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:19.020 nvme0n1 00:24:19.020 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.020 15:11:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:19.020 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.020 15:11:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:19.020 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:19.020 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.020 15:11:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:19.020 15:11:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:19.020 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.020 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:19.020 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.020 15:11:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:19.020 15:11:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:24:19.020 15:11:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:19.020 15:11:59 -- host/auth.sh@44 -- # digest=sha256 00:24:19.020 15:11:59 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:19.020 15:11:59 -- host/auth.sh@44 -- # keyid=1 00:24:19.020 15:11:59 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:19.020 15:11:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:19.020 15:11:59 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:19.020 15:11:59 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:19.020 15:11:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:24:19.020 15:11:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:19.020 15:11:59 -- host/auth.sh@68 -- # digest=sha256 00:24:19.020 15:11:59 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:19.020 15:11:59 -- host/auth.sh@68 -- # keyid=1 00:24:19.020 15:11:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:24:19.020 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.020 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:19.020 15:11:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.020 15:11:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:19.020 15:11:59 -- nvmf/common.sh@717 -- # local ip 00:24:19.020 15:11:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:19.020 15:11:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:19.020 15:11:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:19.020 15:11:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:19.020 15:11:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:19.020 15:11:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:19.020 15:11:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:19.020 15:11:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:19.020 15:11:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:19.020 15:11:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:19.020 15:11:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.020 15:11:59 -- common/autotest_common.sh@10 -- # set +x 00:24:19.592 nvme0n1 00:24:19.592 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.592 15:12:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:19.592 15:12:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:19.592 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.592 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:19.592 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.592 15:12:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:19.592 15:12:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:19.592 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.592 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:19.592 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.592 15:12:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:19.592 15:12:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:24:19.592 15:12:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:19.592 15:12:00 -- host/auth.sh@44 -- # digest=sha256 00:24:19.592 15:12:00 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:19.592 15:12:00 -- host/auth.sh@44 -- # keyid=2 00:24:19.592 15:12:00 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:19.592 15:12:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:19.592 15:12:00 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:19.592 15:12:00 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:19.592 15:12:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:24:19.592 15:12:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:19.592 15:12:00 -- host/auth.sh@68 -- # digest=sha256 00:24:19.592 15:12:00 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:19.592 15:12:00 -- host/auth.sh@68 -- # keyid=2 00:24:19.592 15:12:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:24:19.592 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.592 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:19.592 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:19.592 15:12:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:19.592 15:12:00 -- nvmf/common.sh@717 -- # local ip 00:24:19.592 15:12:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:19.592 15:12:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:19.592 15:12:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:19.592 15:12:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:19.592 15:12:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:19.592 15:12:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:19.592 15:12:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:19.592 15:12:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:19.592 15:12:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:19.592 15:12:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:19.592 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:19.592 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:20.164 nvme0n1 00:24:20.164 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.164 15:12:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:20.164 15:12:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:20.164 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.164 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:20.164 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.164 15:12:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:20.164 15:12:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:20.164 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.164 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:20.165 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.165 15:12:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:20.165 15:12:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:24:20.165 15:12:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:20.165 15:12:00 -- host/auth.sh@44 -- # digest=sha256 00:24:20.165 15:12:00 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:20.165 15:12:00 -- host/auth.sh@44 -- # keyid=3 00:24:20.165 15:12:00 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:20.165 15:12:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:20.165 15:12:00 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:20.165 15:12:00 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:20.165 15:12:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:24:20.165 15:12:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:20.165 15:12:00 -- host/auth.sh@68 -- # digest=sha256 00:24:20.165 15:12:00 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:20.165 15:12:00 -- host/auth.sh@68 -- # keyid=3 00:24:20.165 15:12:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:24:20.165 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.165 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:20.165 15:12:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.165 15:12:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:20.165 15:12:00 -- nvmf/common.sh@717 -- # local ip 00:24:20.165 15:12:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:20.165 15:12:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:20.165 15:12:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:20.165 15:12:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:20.165 15:12:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:20.165 15:12:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:20.165 15:12:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:20.165 15:12:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:20.165 15:12:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:20.165 15:12:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:20.165 15:12:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.165 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:24:20.737 nvme0n1 00:24:20.737 15:12:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.737 15:12:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:20.737 15:12:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.737 15:12:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:20.737 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:24:20.737 15:12:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.737 15:12:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:20.737 15:12:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:20.737 15:12:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.737 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:24:20.737 15:12:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.737 15:12:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:20.737 15:12:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:24:20.737 15:12:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:20.737 15:12:01 -- host/auth.sh@44 -- # digest=sha256 00:24:20.737 15:12:01 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:20.737 15:12:01 -- host/auth.sh@44 -- # keyid=4 00:24:20.737 15:12:01 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:20.737 15:12:01 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:20.737 15:12:01 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:20.737 15:12:01 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:20.737 15:12:01 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:24:20.737 15:12:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:20.737 15:12:01 -- host/auth.sh@68 -- # digest=sha256 00:24:20.737 15:12:01 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:20.737 15:12:01 -- host/auth.sh@68 -- # keyid=4 00:24:20.737 15:12:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:24:20.737 15:12:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.737 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:24:20.737 15:12:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:20.737 15:12:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:20.737 15:12:01 -- nvmf/common.sh@717 -- # local ip 00:24:20.737 15:12:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:20.737 15:12:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:20.737 15:12:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:20.737 15:12:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:20.737 15:12:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:20.737 15:12:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:20.737 15:12:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:20.737 15:12:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:20.737 15:12:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:20.737 15:12:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:20.737 15:12:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:20.737 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:24:21.312 nvme0n1 00:24:21.312 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:21.312 15:12:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:21.312 15:12:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:21.312 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:21.312 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:21.312 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:21.312 15:12:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:21.312 15:12:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:21.312 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:21.312 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:21.312 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:21.312 15:12:02 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:21.312 15:12:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:21.312 15:12:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:24:21.312 15:12:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:21.312 15:12:02 -- host/auth.sh@44 -- # digest=sha256 00:24:21.312 15:12:02 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:21.312 15:12:02 -- host/auth.sh@44 -- # keyid=0 00:24:21.312 15:12:02 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:21.312 15:12:02 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:21.312 15:12:02 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:21.312 15:12:02 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:21.312 15:12:02 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:24:21.312 15:12:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:21.312 15:12:02 -- host/auth.sh@68 -- # digest=sha256 00:24:21.312 15:12:02 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:21.312 15:12:02 -- host/auth.sh@68 -- # keyid=0 00:24:21.312 15:12:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:24:21.312 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:21.312 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:21.312 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:21.312 15:12:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:21.312 15:12:02 -- nvmf/common.sh@717 -- # local ip 00:24:21.312 15:12:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:21.312 15:12:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:21.312 15:12:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:21.312 15:12:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:21.312 15:12:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:21.312 15:12:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:21.312 15:12:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:21.312 15:12:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:21.312 15:12:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:21.312 15:12:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:21.312 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:21.312 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:22.255 nvme0n1 00:24:22.255 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.255 15:12:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:22.255 15:12:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:22.255 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.255 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:22.255 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.255 15:12:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:22.255 15:12:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:22.256 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.256 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:22.256 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.256 15:12:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:22.256 15:12:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:24:22.256 15:12:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:22.256 15:12:02 -- host/auth.sh@44 -- # digest=sha256 00:24:22.256 15:12:02 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:22.256 15:12:02 -- host/auth.sh@44 -- # keyid=1 00:24:22.256 15:12:02 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:22.256 15:12:02 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:22.256 15:12:02 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:22.256 15:12:02 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:22.256 15:12:02 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:24:22.256 15:12:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:22.256 15:12:02 -- host/auth.sh@68 -- # digest=sha256 00:24:22.256 15:12:02 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:22.256 15:12:02 -- host/auth.sh@68 -- # keyid=1 00:24:22.256 15:12:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:24:22.256 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.256 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:22.256 15:12:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.256 15:12:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:22.256 15:12:02 -- nvmf/common.sh@717 -- # local ip 00:24:22.256 15:12:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:22.256 15:12:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:22.256 15:12:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:22.256 15:12:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:22.256 15:12:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:22.256 15:12:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:22.256 15:12:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:22.256 15:12:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:22.256 15:12:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:22.256 15:12:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:22.256 15:12:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.256 15:12:02 -- common/autotest_common.sh@10 -- # set +x 00:24:22.826 nvme0n1 00:24:22.826 15:12:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.826 15:12:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:22.826 15:12:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:22.826 15:12:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.826 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:24:22.826 15:12:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:22.826 15:12:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:22.826 15:12:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:22.826 15:12:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:22.826 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:24:23.087 15:12:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.087 15:12:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:23.087 15:12:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:24:23.087 15:12:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:23.087 15:12:03 -- host/auth.sh@44 -- # digest=sha256 00:24:23.087 15:12:03 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:23.087 15:12:03 -- host/auth.sh@44 -- # keyid=2 00:24:23.087 15:12:03 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:23.087 15:12:03 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:23.087 15:12:03 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:23.087 15:12:03 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:23.087 15:12:03 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:24:23.087 15:12:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:23.087 15:12:03 -- host/auth.sh@68 -- # digest=sha256 00:24:23.087 15:12:03 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:23.087 15:12:03 -- host/auth.sh@68 -- # keyid=2 00:24:23.087 15:12:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:24:23.087 15:12:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.087 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:24:23.087 15:12:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.087 15:12:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:23.087 15:12:03 -- nvmf/common.sh@717 -- # local ip 00:24:23.087 15:12:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:23.087 15:12:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:23.087 15:12:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:23.087 15:12:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:23.087 15:12:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:23.087 15:12:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:23.087 15:12:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:23.087 15:12:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:23.087 15:12:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:23.087 15:12:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:23.087 15:12:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.087 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:24:23.658 nvme0n1 00:24:23.658 15:12:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.658 15:12:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:23.658 15:12:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.658 15:12:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:23.658 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:24:23.658 15:12:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.658 15:12:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:23.658 15:12:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:23.658 15:12:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.658 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:24:23.919 15:12:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.919 15:12:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:23.919 15:12:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:24:23.919 15:12:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:23.919 15:12:04 -- host/auth.sh@44 -- # digest=sha256 00:24:23.919 15:12:04 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:23.919 15:12:04 -- host/auth.sh@44 -- # keyid=3 00:24:23.919 15:12:04 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:23.919 15:12:04 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:23.919 15:12:04 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:23.919 15:12:04 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:23.920 15:12:04 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:24:23.920 15:12:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:23.920 15:12:04 -- host/auth.sh@68 -- # digest=sha256 00:24:23.920 15:12:04 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:23.920 15:12:04 -- host/auth.sh@68 -- # keyid=3 00:24:23.920 15:12:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:24:23.920 15:12:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.920 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:24:23.920 15:12:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:23.920 15:12:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:23.920 15:12:04 -- nvmf/common.sh@717 -- # local ip 00:24:23.920 15:12:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:23.920 15:12:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:23.920 15:12:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:23.920 15:12:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:23.920 15:12:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:23.920 15:12:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:23.920 15:12:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:23.920 15:12:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:23.920 15:12:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:23.920 15:12:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:23.920 15:12:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:23.920 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:24:24.492 nvme0n1 00:24:24.492 15:12:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:24.492 15:12:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:24.492 15:12:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:24.492 15:12:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:24.492 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:24:24.492 15:12:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:24.753 15:12:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:24.753 15:12:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:24.753 15:12:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:24.753 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:24:24.753 15:12:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:24.753 15:12:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:24.753 15:12:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:24:24.753 15:12:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:24.753 15:12:05 -- host/auth.sh@44 -- # digest=sha256 00:24:24.753 15:12:05 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:24.753 15:12:05 -- host/auth.sh@44 -- # keyid=4 00:24:24.753 15:12:05 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:24.753 15:12:05 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:24.753 15:12:05 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:24.753 15:12:05 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:24.753 15:12:05 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:24:24.753 15:12:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:24.753 15:12:05 -- host/auth.sh@68 -- # digest=sha256 00:24:24.753 15:12:05 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:24.753 15:12:05 -- host/auth.sh@68 -- # keyid=4 00:24:24.753 15:12:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:24:24.753 15:12:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:24.753 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:24:24.753 15:12:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:24.753 15:12:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:24.753 15:12:05 -- nvmf/common.sh@717 -- # local ip 00:24:24.753 15:12:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:24.753 15:12:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:24.753 15:12:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:24.753 15:12:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:24.753 15:12:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:24.753 15:12:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:24.754 15:12:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:24.754 15:12:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:24.754 15:12:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:24.754 15:12:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:24.754 15:12:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:24.754 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:24:25.325 nvme0n1 00:24:25.325 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.325 15:12:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:25.325 15:12:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:25.325 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.325 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.325 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.617 15:12:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:25.617 15:12:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:25.617 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.617 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.617 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.617 15:12:06 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:24:25.617 15:12:06 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:25.617 15:12:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:25.617 15:12:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:24:25.617 15:12:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:25.617 15:12:06 -- host/auth.sh@44 -- # digest=sha384 00:24:25.617 15:12:06 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:25.617 15:12:06 -- host/auth.sh@44 -- # keyid=0 00:24:25.617 15:12:06 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:25.617 15:12:06 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:25.617 15:12:06 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:25.617 15:12:06 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:25.617 15:12:06 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:24:25.617 15:12:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:25.617 15:12:06 -- host/auth.sh@68 -- # digest=sha384 00:24:25.617 15:12:06 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:25.617 15:12:06 -- host/auth.sh@68 -- # keyid=0 00:24:25.617 15:12:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:24:25.617 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.617 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.617 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.617 15:12:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:25.617 15:12:06 -- nvmf/common.sh@717 -- # local ip 00:24:25.617 15:12:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:25.617 15:12:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:25.617 15:12:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:25.617 15:12:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:25.617 15:12:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:25.617 15:12:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:25.617 15:12:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:25.617 15:12:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:25.617 15:12:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:25.617 15:12:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:25.617 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.617 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.617 nvme0n1 00:24:25.617 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.617 15:12:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:25.617 15:12:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:25.617 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.617 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.617 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.878 15:12:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:25.878 15:12:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:25.878 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.878 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.878 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.878 15:12:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:25.878 15:12:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:24:25.878 15:12:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:25.878 15:12:06 -- host/auth.sh@44 -- # digest=sha384 00:24:25.878 15:12:06 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:25.878 15:12:06 -- host/auth.sh@44 -- # keyid=1 00:24:25.878 15:12:06 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:25.878 15:12:06 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:25.878 15:12:06 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:25.878 15:12:06 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:25.878 15:12:06 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:24:25.878 15:12:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:25.878 15:12:06 -- host/auth.sh@68 -- # digest=sha384 00:24:25.878 15:12:06 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:25.878 15:12:06 -- host/auth.sh@68 -- # keyid=1 00:24:25.878 15:12:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:24:25.878 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.878 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:25.878 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:25.878 15:12:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:25.878 15:12:06 -- nvmf/common.sh@717 -- # local ip 00:24:25.878 15:12:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:25.878 15:12:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:25.878 15:12:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:25.878 15:12:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:25.878 15:12:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:25.878 15:12:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:25.878 15:12:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:25.878 15:12:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:25.878 15:12:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:25.878 15:12:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:25.878 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:25.878 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.139 nvme0n1 00:24:26.139 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.139 15:12:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:26.139 15:12:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:26.139 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.139 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.139 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.139 15:12:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:26.139 15:12:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:26.139 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.139 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.139 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.139 15:12:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:26.139 15:12:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:24:26.139 15:12:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:26.139 15:12:06 -- host/auth.sh@44 -- # digest=sha384 00:24:26.139 15:12:06 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:26.139 15:12:06 -- host/auth.sh@44 -- # keyid=2 00:24:26.139 15:12:06 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:26.139 15:12:06 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:26.139 15:12:06 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:26.139 15:12:06 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:26.139 15:12:06 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:24:26.139 15:12:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:26.139 15:12:06 -- host/auth.sh@68 -- # digest=sha384 00:24:26.139 15:12:06 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:26.139 15:12:06 -- host/auth.sh@68 -- # keyid=2 00:24:26.139 15:12:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:24:26.139 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.139 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.139 15:12:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.139 15:12:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:26.139 15:12:06 -- nvmf/common.sh@717 -- # local ip 00:24:26.139 15:12:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:26.139 15:12:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:26.139 15:12:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:26.139 15:12:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:26.139 15:12:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:26.139 15:12:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:26.139 15:12:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:26.139 15:12:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:26.139 15:12:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:26.139 15:12:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:26.139 15:12:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.139 15:12:06 -- common/autotest_common.sh@10 -- # set +x 00:24:26.400 nvme0n1 00:24:26.400 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.400 15:12:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:26.400 15:12:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:26.400 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.400 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.400 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.400 15:12:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:26.400 15:12:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:26.400 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.400 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.400 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.400 15:12:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:26.400 15:12:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:24:26.400 15:12:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:26.400 15:12:07 -- host/auth.sh@44 -- # digest=sha384 00:24:26.400 15:12:07 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:26.400 15:12:07 -- host/auth.sh@44 -- # keyid=3 00:24:26.400 15:12:07 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:26.400 15:12:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:26.400 15:12:07 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:26.400 15:12:07 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:26.400 15:12:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:24:26.400 15:12:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:26.400 15:12:07 -- host/auth.sh@68 -- # digest=sha384 00:24:26.400 15:12:07 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:26.400 15:12:07 -- host/auth.sh@68 -- # keyid=3 00:24:26.400 15:12:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:24:26.400 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.400 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.400 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.400 15:12:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:26.400 15:12:07 -- nvmf/common.sh@717 -- # local ip 00:24:26.400 15:12:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:26.400 15:12:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:26.400 15:12:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:26.400 15:12:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:26.400 15:12:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:26.400 15:12:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:26.400 15:12:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:26.400 15:12:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:26.400 15:12:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:26.400 15:12:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:26.400 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.400 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.661 nvme0n1 00:24:26.661 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.661 15:12:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:26.661 15:12:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:26.661 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.661 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.661 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.661 15:12:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:26.661 15:12:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:26.661 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.661 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.661 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.661 15:12:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:26.661 15:12:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:24:26.661 15:12:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:26.661 15:12:07 -- host/auth.sh@44 -- # digest=sha384 00:24:26.661 15:12:07 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:26.661 15:12:07 -- host/auth.sh@44 -- # keyid=4 00:24:26.661 15:12:07 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:26.661 15:12:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:26.661 15:12:07 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:26.661 15:12:07 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:26.661 15:12:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:24:26.661 15:12:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:26.661 15:12:07 -- host/auth.sh@68 -- # digest=sha384 00:24:26.661 15:12:07 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:26.661 15:12:07 -- host/auth.sh@68 -- # keyid=4 00:24:26.661 15:12:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:24:26.661 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.661 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.661 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.661 15:12:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:26.661 15:12:07 -- nvmf/common.sh@717 -- # local ip 00:24:26.661 15:12:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:26.661 15:12:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:26.661 15:12:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:26.661 15:12:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:26.661 15:12:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:26.661 15:12:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:26.661 15:12:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:26.661 15:12:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:26.661 15:12:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:26.661 15:12:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:26.661 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.661 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.922 nvme0n1 00:24:26.922 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.922 15:12:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:26.922 15:12:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:26.922 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.922 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.922 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.922 15:12:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:26.922 15:12:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:26.922 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.922 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.922 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.922 15:12:07 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:26.922 15:12:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:26.922 15:12:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:24:26.922 15:12:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:26.922 15:12:07 -- host/auth.sh@44 -- # digest=sha384 00:24:26.922 15:12:07 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:26.922 15:12:07 -- host/auth.sh@44 -- # keyid=0 00:24:26.922 15:12:07 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:26.922 15:12:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:26.922 15:12:07 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:26.922 15:12:07 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:26.922 15:12:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:24:26.922 15:12:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:26.922 15:12:07 -- host/auth.sh@68 -- # digest=sha384 00:24:26.922 15:12:07 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:26.922 15:12:07 -- host/auth.sh@68 -- # keyid=0 00:24:26.922 15:12:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:24:26.922 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.922 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:26.922 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:26.922 15:12:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:26.922 15:12:07 -- nvmf/common.sh@717 -- # local ip 00:24:26.922 15:12:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:26.922 15:12:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:26.922 15:12:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:26.922 15:12:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:26.922 15:12:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:26.922 15:12:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:26.922 15:12:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:26.922 15:12:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:26.922 15:12:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:26.922 15:12:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:26.922 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:26.922 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:27.184 nvme0n1 00:24:27.184 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.184 15:12:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:27.184 15:12:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:27.184 15:12:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.184 15:12:07 -- common/autotest_common.sh@10 -- # set +x 00:24:27.184 15:12:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.184 15:12:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:27.184 15:12:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:27.184 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.184 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.184 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.184 15:12:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:27.184 15:12:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:24:27.184 15:12:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:27.184 15:12:08 -- host/auth.sh@44 -- # digest=sha384 00:24:27.184 15:12:08 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:27.184 15:12:08 -- host/auth.sh@44 -- # keyid=1 00:24:27.184 15:12:08 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:27.184 15:12:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:27.184 15:12:08 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:27.184 15:12:08 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:27.184 15:12:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:24:27.184 15:12:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:27.184 15:12:08 -- host/auth.sh@68 -- # digest=sha384 00:24:27.184 15:12:08 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:27.184 15:12:08 -- host/auth.sh@68 -- # keyid=1 00:24:27.184 15:12:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:24:27.184 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.184 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.184 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.184 15:12:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:27.184 15:12:08 -- nvmf/common.sh@717 -- # local ip 00:24:27.184 15:12:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:27.184 15:12:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:27.184 15:12:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:27.184 15:12:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:27.184 15:12:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:27.184 15:12:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:27.184 15:12:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:27.184 15:12:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:27.184 15:12:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:27.184 15:12:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:27.184 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.184 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.446 nvme0n1 00:24:27.446 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.446 15:12:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:27.446 15:12:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:27.446 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.446 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.446 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.446 15:12:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:27.446 15:12:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:27.446 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.446 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.446 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.446 15:12:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:27.446 15:12:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:24:27.446 15:12:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:27.446 15:12:08 -- host/auth.sh@44 -- # digest=sha384 00:24:27.446 15:12:08 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:27.446 15:12:08 -- host/auth.sh@44 -- # keyid=2 00:24:27.446 15:12:08 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:27.446 15:12:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:27.447 15:12:08 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:27.447 15:12:08 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:27.447 15:12:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:24:27.447 15:12:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:27.447 15:12:08 -- host/auth.sh@68 -- # digest=sha384 00:24:27.447 15:12:08 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:27.447 15:12:08 -- host/auth.sh@68 -- # keyid=2 00:24:27.447 15:12:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:24:27.447 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.447 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.447 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.447 15:12:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:27.447 15:12:08 -- nvmf/common.sh@717 -- # local ip 00:24:27.447 15:12:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:27.447 15:12:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:27.447 15:12:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:27.447 15:12:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:27.447 15:12:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:27.447 15:12:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:27.447 15:12:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:27.447 15:12:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:27.447 15:12:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:27.447 15:12:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:27.447 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.447 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.708 nvme0n1 00:24:27.708 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.708 15:12:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:27.708 15:12:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:27.708 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.708 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.708 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.708 15:12:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:27.708 15:12:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:27.708 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.708 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.970 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.970 15:12:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:27.970 15:12:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:24:27.970 15:12:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:27.970 15:12:08 -- host/auth.sh@44 -- # digest=sha384 00:24:27.970 15:12:08 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:27.970 15:12:08 -- host/auth.sh@44 -- # keyid=3 00:24:27.970 15:12:08 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:27.970 15:12:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:27.970 15:12:08 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:27.970 15:12:08 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:27.970 15:12:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:24:27.970 15:12:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:27.970 15:12:08 -- host/auth.sh@68 -- # digest=sha384 00:24:27.970 15:12:08 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:27.970 15:12:08 -- host/auth.sh@68 -- # keyid=3 00:24:27.970 15:12:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:24:27.970 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.970 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:27.970 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:27.970 15:12:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:27.970 15:12:08 -- nvmf/common.sh@717 -- # local ip 00:24:27.970 15:12:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:27.970 15:12:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:27.970 15:12:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:27.970 15:12:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:27.970 15:12:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:27.970 15:12:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:27.970 15:12:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:27.970 15:12:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:27.970 15:12:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:27.970 15:12:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:27.970 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:27.970 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:28.231 nvme0n1 00:24:28.231 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.231 15:12:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:28.231 15:12:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:28.231 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.231 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:28.231 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.231 15:12:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:28.231 15:12:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:28.231 15:12:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.231 15:12:08 -- common/autotest_common.sh@10 -- # set +x 00:24:28.231 15:12:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.231 15:12:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:28.231 15:12:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:24:28.231 15:12:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:28.231 15:12:08 -- host/auth.sh@44 -- # digest=sha384 00:24:28.231 15:12:08 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:28.231 15:12:08 -- host/auth.sh@44 -- # keyid=4 00:24:28.231 15:12:08 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:28.231 15:12:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:28.231 15:12:08 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:28.231 15:12:08 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:28.231 15:12:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:24:28.231 15:12:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:28.231 15:12:09 -- host/auth.sh@68 -- # digest=sha384 00:24:28.231 15:12:09 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:28.231 15:12:09 -- host/auth.sh@68 -- # keyid=4 00:24:28.231 15:12:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:24:28.231 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.231 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.231 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.231 15:12:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:28.231 15:12:09 -- nvmf/common.sh@717 -- # local ip 00:24:28.231 15:12:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:28.231 15:12:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:28.231 15:12:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:28.231 15:12:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:28.231 15:12:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:28.232 15:12:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:28.232 15:12:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:28.232 15:12:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:28.232 15:12:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:28.232 15:12:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:28.232 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.232 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.556 nvme0n1 00:24:28.556 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.557 15:12:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:28.557 15:12:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:28.557 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.557 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.557 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.557 15:12:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:28.557 15:12:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:28.557 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.557 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.557 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.557 15:12:09 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:28.557 15:12:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:28.557 15:12:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:24:28.557 15:12:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:28.557 15:12:09 -- host/auth.sh@44 -- # digest=sha384 00:24:28.557 15:12:09 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:28.557 15:12:09 -- host/auth.sh@44 -- # keyid=0 00:24:28.557 15:12:09 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:28.557 15:12:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:28.557 15:12:09 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:28.557 15:12:09 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:28.557 15:12:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:24:28.557 15:12:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:28.557 15:12:09 -- host/auth.sh@68 -- # digest=sha384 00:24:28.557 15:12:09 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:28.557 15:12:09 -- host/auth.sh@68 -- # keyid=0 00:24:28.557 15:12:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:24:28.557 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.557 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.557 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.557 15:12:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:28.557 15:12:09 -- nvmf/common.sh@717 -- # local ip 00:24:28.557 15:12:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:28.557 15:12:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:28.557 15:12:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:28.557 15:12:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:28.557 15:12:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:28.557 15:12:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:28.557 15:12:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:28.557 15:12:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:28.557 15:12:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:28.557 15:12:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:28.557 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.557 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.836 nvme0n1 00:24:28.836 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.836 15:12:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:28.836 15:12:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:28.836 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.836 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.836 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.836 15:12:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:28.836 15:12:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:28.836 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.836 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.836 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.836 15:12:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:28.836 15:12:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:24:28.836 15:12:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:28.836 15:12:09 -- host/auth.sh@44 -- # digest=sha384 00:24:28.836 15:12:09 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:28.836 15:12:09 -- host/auth.sh@44 -- # keyid=1 00:24:28.836 15:12:09 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:28.836 15:12:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:28.836 15:12:09 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:28.836 15:12:09 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:28.836 15:12:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:24:28.836 15:12:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:28.836 15:12:09 -- host/auth.sh@68 -- # digest=sha384 00:24:28.836 15:12:09 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:28.836 15:12:09 -- host/auth.sh@68 -- # keyid=1 00:24:28.836 15:12:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:24:28.836 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.836 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:28.836 15:12:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:28.836 15:12:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:28.836 15:12:09 -- nvmf/common.sh@717 -- # local ip 00:24:28.836 15:12:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:28.836 15:12:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:28.836 15:12:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:28.836 15:12:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:28.836 15:12:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:28.836 15:12:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:28.836 15:12:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:28.836 15:12:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:28.836 15:12:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:28.836 15:12:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:28.836 15:12:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:28.836 15:12:09 -- common/autotest_common.sh@10 -- # set +x 00:24:29.097 nvme0n1 00:24:29.097 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.097 15:12:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:29.097 15:12:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:29.097 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.097 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.097 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.359 15:12:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:29.359 15:12:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:29.359 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.359 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.359 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.359 15:12:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:29.359 15:12:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:24:29.359 15:12:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:29.359 15:12:10 -- host/auth.sh@44 -- # digest=sha384 00:24:29.359 15:12:10 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:29.359 15:12:10 -- host/auth.sh@44 -- # keyid=2 00:24:29.359 15:12:10 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:29.359 15:12:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:29.359 15:12:10 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:29.359 15:12:10 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:29.359 15:12:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:24:29.359 15:12:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:29.359 15:12:10 -- host/auth.sh@68 -- # digest=sha384 00:24:29.359 15:12:10 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:29.359 15:12:10 -- host/auth.sh@68 -- # keyid=2 00:24:29.359 15:12:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:24:29.359 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.359 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.359 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.359 15:12:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:29.359 15:12:10 -- nvmf/common.sh@717 -- # local ip 00:24:29.359 15:12:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:29.359 15:12:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:29.359 15:12:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:29.359 15:12:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:29.359 15:12:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:29.359 15:12:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:29.359 15:12:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:29.359 15:12:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:29.359 15:12:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:29.359 15:12:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:29.359 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.359 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.620 nvme0n1 00:24:29.620 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.620 15:12:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:29.620 15:12:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:29.620 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.620 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.620 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.620 15:12:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:29.620 15:12:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:29.620 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.620 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.620 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.620 15:12:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:29.620 15:12:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:24:29.620 15:12:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:29.620 15:12:10 -- host/auth.sh@44 -- # digest=sha384 00:24:29.620 15:12:10 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:29.620 15:12:10 -- host/auth.sh@44 -- # keyid=3 00:24:29.620 15:12:10 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:29.620 15:12:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:29.620 15:12:10 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:29.620 15:12:10 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:29.620 15:12:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:24:29.620 15:12:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:29.620 15:12:10 -- host/auth.sh@68 -- # digest=sha384 00:24:29.620 15:12:10 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:29.620 15:12:10 -- host/auth.sh@68 -- # keyid=3 00:24:29.620 15:12:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:24:29.620 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.620 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.620 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.620 15:12:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:29.620 15:12:10 -- nvmf/common.sh@717 -- # local ip 00:24:29.620 15:12:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:29.620 15:12:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:29.620 15:12:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:29.620 15:12:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:29.620 15:12:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:29.620 15:12:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:29.620 15:12:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:29.620 15:12:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:29.620 15:12:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:29.620 15:12:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:29.620 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.620 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.881 nvme0n1 00:24:29.881 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:29.881 15:12:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:29.881 15:12:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:29.881 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:29.881 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:29.881 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.141 15:12:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:30.141 15:12:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:30.141 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.141 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:30.141 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.141 15:12:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:30.141 15:12:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:24:30.141 15:12:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:30.141 15:12:10 -- host/auth.sh@44 -- # digest=sha384 00:24:30.142 15:12:10 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:30.142 15:12:10 -- host/auth.sh@44 -- # keyid=4 00:24:30.142 15:12:10 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:30.142 15:12:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:30.142 15:12:10 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:30.142 15:12:10 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:30.142 15:12:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:24:30.142 15:12:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:30.142 15:12:10 -- host/auth.sh@68 -- # digest=sha384 00:24:30.142 15:12:10 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:30.142 15:12:10 -- host/auth.sh@68 -- # keyid=4 00:24:30.142 15:12:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:24:30.142 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.142 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:30.142 15:12:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.142 15:12:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:30.142 15:12:10 -- nvmf/common.sh@717 -- # local ip 00:24:30.142 15:12:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:30.142 15:12:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:30.142 15:12:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:30.142 15:12:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:30.142 15:12:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:30.142 15:12:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:30.142 15:12:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:30.142 15:12:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:30.142 15:12:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:30.142 15:12:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:30.142 15:12:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.142 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:24:30.403 nvme0n1 00:24:30.403 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.403 15:12:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:30.403 15:12:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:30.403 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.403 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.403 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.403 15:12:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:30.403 15:12:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:30.403 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.403 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.403 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.403 15:12:11 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:30.403 15:12:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:30.403 15:12:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:24:30.403 15:12:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:30.403 15:12:11 -- host/auth.sh@44 -- # digest=sha384 00:24:30.403 15:12:11 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:30.403 15:12:11 -- host/auth.sh@44 -- # keyid=0 00:24:30.403 15:12:11 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:30.403 15:12:11 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:30.403 15:12:11 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:30.403 15:12:11 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:30.403 15:12:11 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:24:30.403 15:12:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:30.403 15:12:11 -- host/auth.sh@68 -- # digest=sha384 00:24:30.403 15:12:11 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:30.403 15:12:11 -- host/auth.sh@68 -- # keyid=0 00:24:30.403 15:12:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:24:30.403 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.403 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.403 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.403 15:12:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:30.403 15:12:11 -- nvmf/common.sh@717 -- # local ip 00:24:30.403 15:12:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:30.403 15:12:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:30.403 15:12:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:30.403 15:12:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:30.403 15:12:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:30.403 15:12:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:30.403 15:12:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:30.403 15:12:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:30.403 15:12:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:30.403 15:12:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:30.403 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.403 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.975 nvme0n1 00:24:30.975 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.975 15:12:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:30.975 15:12:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:30.975 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.975 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.975 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.975 15:12:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:30.975 15:12:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:30.975 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.975 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.975 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.975 15:12:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:30.976 15:12:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:24:30.976 15:12:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:30.976 15:12:11 -- host/auth.sh@44 -- # digest=sha384 00:24:30.976 15:12:11 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:30.976 15:12:11 -- host/auth.sh@44 -- # keyid=1 00:24:30.976 15:12:11 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:30.976 15:12:11 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:30.976 15:12:11 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:30.976 15:12:11 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:30.976 15:12:11 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:24:30.976 15:12:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:30.976 15:12:11 -- host/auth.sh@68 -- # digest=sha384 00:24:30.976 15:12:11 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:30.976 15:12:11 -- host/auth.sh@68 -- # keyid=1 00:24:30.976 15:12:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:24:30.976 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.976 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:30.976 15:12:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:30.976 15:12:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:30.976 15:12:11 -- nvmf/common.sh@717 -- # local ip 00:24:30.976 15:12:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:30.976 15:12:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:30.976 15:12:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:30.976 15:12:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:30.976 15:12:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:30.976 15:12:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:30.976 15:12:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:30.976 15:12:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:30.976 15:12:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:30.976 15:12:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:30.976 15:12:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:30.976 15:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:31.548 nvme0n1 00:24:31.548 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:31.548 15:12:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:31.548 15:12:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:31.548 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:31.548 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:31.548 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:31.548 15:12:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:31.548 15:12:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:31.548 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:31.548 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:31.548 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:31.548 15:12:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:31.548 15:12:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:24:31.548 15:12:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:31.548 15:12:12 -- host/auth.sh@44 -- # digest=sha384 00:24:31.548 15:12:12 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:31.548 15:12:12 -- host/auth.sh@44 -- # keyid=2 00:24:31.548 15:12:12 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:31.548 15:12:12 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:31.548 15:12:12 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:31.548 15:12:12 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:31.548 15:12:12 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:24:31.548 15:12:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:31.548 15:12:12 -- host/auth.sh@68 -- # digest=sha384 00:24:31.548 15:12:12 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:31.548 15:12:12 -- host/auth.sh@68 -- # keyid=2 00:24:31.548 15:12:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:24:31.548 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:31.548 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:31.548 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:31.548 15:12:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:31.548 15:12:12 -- nvmf/common.sh@717 -- # local ip 00:24:31.548 15:12:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:31.548 15:12:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:31.548 15:12:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:31.548 15:12:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:31.548 15:12:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:31.548 15:12:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:31.548 15:12:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:31.548 15:12:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:31.548 15:12:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:31.548 15:12:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:31.548 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:31.548 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:32.120 nvme0n1 00:24:32.120 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.120 15:12:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:32.120 15:12:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:32.120 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.120 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:32.120 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.120 15:12:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:32.120 15:12:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:32.120 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.120 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:32.120 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.120 15:12:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:32.120 15:12:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:24:32.120 15:12:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:32.120 15:12:12 -- host/auth.sh@44 -- # digest=sha384 00:24:32.120 15:12:12 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:32.120 15:12:12 -- host/auth.sh@44 -- # keyid=3 00:24:32.120 15:12:12 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:32.120 15:12:12 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:32.120 15:12:12 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:32.120 15:12:12 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:32.120 15:12:12 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:24:32.120 15:12:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:32.120 15:12:12 -- host/auth.sh@68 -- # digest=sha384 00:24:32.120 15:12:12 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:32.120 15:12:12 -- host/auth.sh@68 -- # keyid=3 00:24:32.120 15:12:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:24:32.120 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.120 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:32.120 15:12:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.120 15:12:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:32.121 15:12:12 -- nvmf/common.sh@717 -- # local ip 00:24:32.121 15:12:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:32.121 15:12:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:32.121 15:12:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:32.121 15:12:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:32.121 15:12:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:32.121 15:12:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:32.121 15:12:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:32.121 15:12:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:32.121 15:12:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:32.121 15:12:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:32.121 15:12:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.121 15:12:12 -- common/autotest_common.sh@10 -- # set +x 00:24:32.699 nvme0n1 00:24:32.699 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.699 15:12:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:32.699 15:12:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:32.699 15:12:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.699 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:24:32.699 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.699 15:12:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:32.699 15:12:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:32.699 15:12:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.699 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:24:32.699 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.699 15:12:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:32.699 15:12:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:24:32.699 15:12:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:32.699 15:12:13 -- host/auth.sh@44 -- # digest=sha384 00:24:32.699 15:12:13 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:32.699 15:12:13 -- host/auth.sh@44 -- # keyid=4 00:24:32.699 15:12:13 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:32.699 15:12:13 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:32.699 15:12:13 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:32.699 15:12:13 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:32.699 15:12:13 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:24:32.699 15:12:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:32.699 15:12:13 -- host/auth.sh@68 -- # digest=sha384 00:24:32.699 15:12:13 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:32.699 15:12:13 -- host/auth.sh@68 -- # keyid=4 00:24:32.699 15:12:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:24:32.699 15:12:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.699 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:24:32.699 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:32.699 15:12:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:32.699 15:12:13 -- nvmf/common.sh@717 -- # local ip 00:24:32.699 15:12:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:32.699 15:12:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:32.699 15:12:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:32.699 15:12:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:32.699 15:12:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:32.699 15:12:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:32.699 15:12:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:32.699 15:12:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:32.699 15:12:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:32.699 15:12:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:32.699 15:12:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:32.699 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:24:33.271 nvme0n1 00:24:33.271 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:33.271 15:12:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:33.271 15:12:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:33.271 15:12:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:33.271 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:24:33.271 15:12:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:33.271 15:12:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:33.271 15:12:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:33.271 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:33.271 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:33.271 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:33.271 15:12:14 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:33.271 15:12:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:33.271 15:12:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:24:33.271 15:12:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:33.271 15:12:14 -- host/auth.sh@44 -- # digest=sha384 00:24:33.271 15:12:14 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:33.271 15:12:14 -- host/auth.sh@44 -- # keyid=0 00:24:33.271 15:12:14 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:33.271 15:12:14 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:33.271 15:12:14 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:33.271 15:12:14 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:33.271 15:12:14 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:24:33.271 15:12:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:33.271 15:12:14 -- host/auth.sh@68 -- # digest=sha384 00:24:33.271 15:12:14 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:33.271 15:12:14 -- host/auth.sh@68 -- # keyid=0 00:24:33.271 15:12:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:24:33.271 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:33.271 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:33.271 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:33.271 15:12:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:33.271 15:12:14 -- nvmf/common.sh@717 -- # local ip 00:24:33.271 15:12:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:33.272 15:12:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:33.272 15:12:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:33.272 15:12:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:33.272 15:12:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:33.272 15:12:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:33.272 15:12:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:33.272 15:12:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:33.272 15:12:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:33.272 15:12:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:33.272 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:33.272 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:34.214 nvme0n1 00:24:34.214 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.214 15:12:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:34.214 15:12:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:34.214 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.214 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:34.214 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.214 15:12:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:34.214 15:12:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:34.214 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.214 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:34.214 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.215 15:12:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:34.215 15:12:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:24:34.215 15:12:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:34.215 15:12:14 -- host/auth.sh@44 -- # digest=sha384 00:24:34.215 15:12:14 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:34.215 15:12:14 -- host/auth.sh@44 -- # keyid=1 00:24:34.215 15:12:14 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:34.215 15:12:14 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:34.215 15:12:14 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:34.215 15:12:14 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:34.215 15:12:14 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:24:34.215 15:12:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:34.215 15:12:14 -- host/auth.sh@68 -- # digest=sha384 00:24:34.215 15:12:14 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:34.215 15:12:14 -- host/auth.sh@68 -- # keyid=1 00:24:34.215 15:12:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:24:34.215 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.215 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:34.215 15:12:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.215 15:12:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:34.215 15:12:14 -- nvmf/common.sh@717 -- # local ip 00:24:34.215 15:12:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:34.215 15:12:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:34.215 15:12:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:34.215 15:12:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:34.215 15:12:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:34.215 15:12:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:34.215 15:12:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:34.215 15:12:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:34.215 15:12:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:34.215 15:12:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:34.215 15:12:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.215 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:24:34.787 nvme0n1 00:24:34.787 15:12:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.787 15:12:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:34.787 15:12:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:34.787 15:12:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.787 15:12:15 -- common/autotest_common.sh@10 -- # set +x 00:24:34.787 15:12:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:34.787 15:12:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:34.787 15:12:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:34.787 15:12:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:34.787 15:12:15 -- common/autotest_common.sh@10 -- # set +x 00:24:35.048 15:12:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.048 15:12:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:35.048 15:12:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:24:35.048 15:12:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:35.048 15:12:15 -- host/auth.sh@44 -- # digest=sha384 00:24:35.048 15:12:15 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:35.048 15:12:15 -- host/auth.sh@44 -- # keyid=2 00:24:35.048 15:12:15 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:35.048 15:12:15 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:35.048 15:12:15 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:35.048 15:12:15 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:35.048 15:12:15 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:24:35.048 15:12:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:35.048 15:12:15 -- host/auth.sh@68 -- # digest=sha384 00:24:35.048 15:12:15 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:35.048 15:12:15 -- host/auth.sh@68 -- # keyid=2 00:24:35.048 15:12:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:24:35.048 15:12:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.048 15:12:15 -- common/autotest_common.sh@10 -- # set +x 00:24:35.048 15:12:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.048 15:12:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:35.048 15:12:15 -- nvmf/common.sh@717 -- # local ip 00:24:35.048 15:12:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:35.048 15:12:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:35.048 15:12:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:35.048 15:12:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:35.048 15:12:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:35.048 15:12:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:35.048 15:12:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:35.048 15:12:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:35.048 15:12:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:35.048 15:12:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:35.048 15:12:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.048 15:12:15 -- common/autotest_common.sh@10 -- # set +x 00:24:35.620 nvme0n1 00:24:35.620 15:12:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.620 15:12:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:35.620 15:12:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.620 15:12:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:35.620 15:12:16 -- common/autotest_common.sh@10 -- # set +x 00:24:35.620 15:12:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.620 15:12:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:35.620 15:12:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:35.620 15:12:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.620 15:12:16 -- common/autotest_common.sh@10 -- # set +x 00:24:35.881 15:12:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.881 15:12:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:35.881 15:12:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:24:35.881 15:12:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:35.881 15:12:16 -- host/auth.sh@44 -- # digest=sha384 00:24:35.881 15:12:16 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:35.881 15:12:16 -- host/auth.sh@44 -- # keyid=3 00:24:35.881 15:12:16 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:35.881 15:12:16 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:35.881 15:12:16 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:35.881 15:12:16 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:35.881 15:12:16 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:24:35.881 15:12:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:35.881 15:12:16 -- host/auth.sh@68 -- # digest=sha384 00:24:35.881 15:12:16 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:35.881 15:12:16 -- host/auth.sh@68 -- # keyid=3 00:24:35.881 15:12:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:24:35.881 15:12:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.881 15:12:16 -- common/autotest_common.sh@10 -- # set +x 00:24:35.882 15:12:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:35.882 15:12:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:35.882 15:12:16 -- nvmf/common.sh@717 -- # local ip 00:24:35.882 15:12:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:35.882 15:12:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:35.882 15:12:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:35.882 15:12:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:35.882 15:12:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:35.882 15:12:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:35.882 15:12:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:35.882 15:12:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:35.882 15:12:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:35.882 15:12:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:35.882 15:12:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:35.882 15:12:16 -- common/autotest_common.sh@10 -- # set +x 00:24:36.454 nvme0n1 00:24:36.454 15:12:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:36.454 15:12:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:36.454 15:12:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:36.454 15:12:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:36.454 15:12:17 -- common/autotest_common.sh@10 -- # set +x 00:24:36.454 15:12:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:36.715 15:12:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:36.715 15:12:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:36.715 15:12:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:36.715 15:12:17 -- common/autotest_common.sh@10 -- # set +x 00:24:36.715 15:12:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:36.715 15:12:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:36.715 15:12:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:24:36.715 15:12:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:36.715 15:12:17 -- host/auth.sh@44 -- # digest=sha384 00:24:36.715 15:12:17 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:36.715 15:12:17 -- host/auth.sh@44 -- # keyid=4 00:24:36.715 15:12:17 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:36.715 15:12:17 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:24:36.715 15:12:17 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:36.715 15:12:17 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:36.715 15:12:17 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:24:36.715 15:12:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:36.715 15:12:17 -- host/auth.sh@68 -- # digest=sha384 00:24:36.715 15:12:17 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:36.715 15:12:17 -- host/auth.sh@68 -- # keyid=4 00:24:36.715 15:12:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:24:36.715 15:12:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:36.715 15:12:17 -- common/autotest_common.sh@10 -- # set +x 00:24:36.715 15:12:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:36.715 15:12:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:36.715 15:12:17 -- nvmf/common.sh@717 -- # local ip 00:24:36.715 15:12:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:36.715 15:12:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:36.715 15:12:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:36.715 15:12:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:36.715 15:12:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:36.715 15:12:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:36.715 15:12:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:36.715 15:12:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:36.715 15:12:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:36.715 15:12:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:36.715 15:12:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:36.715 15:12:17 -- common/autotest_common.sh@10 -- # set +x 00:24:37.288 nvme0n1 00:24:37.288 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.288 15:12:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:37.288 15:12:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:37.288 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.288 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.549 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.549 15:12:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:37.549 15:12:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:37.549 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.549 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.549 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.549 15:12:18 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:24:37.549 15:12:18 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:37.549 15:12:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:37.549 15:12:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:24:37.550 15:12:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:37.550 15:12:18 -- host/auth.sh@44 -- # digest=sha512 00:24:37.550 15:12:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:37.550 15:12:18 -- host/auth.sh@44 -- # keyid=0 00:24:37.550 15:12:18 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:37.550 15:12:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:37.550 15:12:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:37.550 15:12:18 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:37.550 15:12:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:24:37.550 15:12:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:37.550 15:12:18 -- host/auth.sh@68 -- # digest=sha512 00:24:37.550 15:12:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:37.550 15:12:18 -- host/auth.sh@68 -- # keyid=0 00:24:37.550 15:12:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:24:37.550 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.550 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.550 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.550 15:12:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:37.550 15:12:18 -- nvmf/common.sh@717 -- # local ip 00:24:37.550 15:12:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:37.550 15:12:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:37.550 15:12:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:37.550 15:12:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:37.550 15:12:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:37.550 15:12:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:37.550 15:12:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:37.550 15:12:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:37.550 15:12:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:37.550 15:12:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:37.550 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.550 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.811 nvme0n1 00:24:37.811 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.811 15:12:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:37.811 15:12:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:37.811 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.811 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.811 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.811 15:12:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:37.811 15:12:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:37.811 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.811 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.811 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.811 15:12:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:37.811 15:12:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:24:37.811 15:12:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:37.811 15:12:18 -- host/auth.sh@44 -- # digest=sha512 00:24:37.811 15:12:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:37.811 15:12:18 -- host/auth.sh@44 -- # keyid=1 00:24:37.811 15:12:18 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:37.811 15:12:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:37.811 15:12:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:37.811 15:12:18 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:37.811 15:12:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:24:37.811 15:12:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:37.811 15:12:18 -- host/auth.sh@68 -- # digest=sha512 00:24:37.811 15:12:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:37.811 15:12:18 -- host/auth.sh@68 -- # keyid=1 00:24:37.811 15:12:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:24:37.811 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.811 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:37.811 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:37.811 15:12:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:37.811 15:12:18 -- nvmf/common.sh@717 -- # local ip 00:24:37.811 15:12:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:37.811 15:12:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:37.811 15:12:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:37.811 15:12:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:37.811 15:12:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:37.811 15:12:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:37.811 15:12:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:37.811 15:12:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:37.811 15:12:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:37.811 15:12:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:37.811 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:37.811 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 nvme0n1 00:24:38.072 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.072 15:12:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:38.072 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.072 15:12:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:38.072 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.072 15:12:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:38.072 15:12:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:38.072 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.072 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.072 15:12:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:38.072 15:12:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:24:38.072 15:12:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:38.072 15:12:18 -- host/auth.sh@44 -- # digest=sha512 00:24:38.072 15:12:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:38.072 15:12:18 -- host/auth.sh@44 -- # keyid=2 00:24:38.072 15:12:18 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:38.072 15:12:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:38.072 15:12:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:38.072 15:12:18 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:38.072 15:12:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:24:38.072 15:12:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:38.072 15:12:18 -- host/auth.sh@68 -- # digest=sha512 00:24:38.072 15:12:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:38.072 15:12:18 -- host/auth.sh@68 -- # keyid=2 00:24:38.072 15:12:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:24:38.072 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.072 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:38.072 15:12:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.072 15:12:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:38.072 15:12:18 -- nvmf/common.sh@717 -- # local ip 00:24:38.072 15:12:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:38.072 15:12:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:38.072 15:12:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:38.072 15:12:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:38.072 15:12:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:38.072 15:12:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:38.072 15:12:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:38.072 15:12:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:38.072 15:12:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:38.072 15:12:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:38.072 15:12:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.072 15:12:18 -- common/autotest_common.sh@10 -- # set +x 00:24:38.334 nvme0n1 00:24:38.334 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.334 15:12:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:38.334 15:12:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:38.334 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.334 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.334 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.334 15:12:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:38.334 15:12:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:38.334 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.334 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.334 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.334 15:12:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:38.334 15:12:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:24:38.334 15:12:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:38.334 15:12:19 -- host/auth.sh@44 -- # digest=sha512 00:24:38.334 15:12:19 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:38.334 15:12:19 -- host/auth.sh@44 -- # keyid=3 00:24:38.334 15:12:19 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:38.334 15:12:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:38.334 15:12:19 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:38.334 15:12:19 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:38.334 15:12:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:24:38.334 15:12:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:38.334 15:12:19 -- host/auth.sh@68 -- # digest=sha512 00:24:38.334 15:12:19 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:38.334 15:12:19 -- host/auth.sh@68 -- # keyid=3 00:24:38.334 15:12:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:24:38.334 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.334 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.334 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.334 15:12:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:38.334 15:12:19 -- nvmf/common.sh@717 -- # local ip 00:24:38.334 15:12:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:38.334 15:12:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:38.334 15:12:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:38.334 15:12:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:38.334 15:12:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:38.334 15:12:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:38.334 15:12:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:38.334 15:12:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:38.334 15:12:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:38.334 15:12:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:38.334 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.334 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.595 nvme0n1 00:24:38.595 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.595 15:12:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:38.595 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.595 15:12:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:38.595 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.595 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.595 15:12:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:38.595 15:12:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:38.595 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.595 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.595 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.595 15:12:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:38.595 15:12:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:24:38.595 15:12:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:38.595 15:12:19 -- host/auth.sh@44 -- # digest=sha512 00:24:38.595 15:12:19 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:38.595 15:12:19 -- host/auth.sh@44 -- # keyid=4 00:24:38.595 15:12:19 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:38.595 15:12:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:38.595 15:12:19 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:38.595 15:12:19 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:38.595 15:12:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:24:38.595 15:12:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:38.595 15:12:19 -- host/auth.sh@68 -- # digest=sha512 00:24:38.595 15:12:19 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:24:38.595 15:12:19 -- host/auth.sh@68 -- # keyid=4 00:24:38.595 15:12:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:24:38.595 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.595 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.595 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.595 15:12:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:38.595 15:12:19 -- nvmf/common.sh@717 -- # local ip 00:24:38.595 15:12:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:38.595 15:12:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:38.595 15:12:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:38.595 15:12:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:38.595 15:12:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:38.595 15:12:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:38.595 15:12:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:38.595 15:12:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:38.595 15:12:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:38.595 15:12:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:38.595 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.595 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.856 nvme0n1 00:24:38.856 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.856 15:12:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:38.856 15:12:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:38.856 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.856 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.856 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.856 15:12:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:38.856 15:12:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:38.856 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.856 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.856 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.856 15:12:19 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:38.856 15:12:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:38.856 15:12:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:24:38.856 15:12:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:38.856 15:12:19 -- host/auth.sh@44 -- # digest=sha512 00:24:38.856 15:12:19 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:38.856 15:12:19 -- host/auth.sh@44 -- # keyid=0 00:24:38.857 15:12:19 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:38.857 15:12:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:38.857 15:12:19 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:38.857 15:12:19 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:38.857 15:12:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:24:38.857 15:12:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:38.857 15:12:19 -- host/auth.sh@68 -- # digest=sha512 00:24:38.857 15:12:19 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:38.857 15:12:19 -- host/auth.sh@68 -- # keyid=0 00:24:38.857 15:12:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:24:38.857 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.857 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:38.857 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:38.857 15:12:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:38.857 15:12:19 -- nvmf/common.sh@717 -- # local ip 00:24:38.857 15:12:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:38.857 15:12:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:38.857 15:12:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:38.857 15:12:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:38.857 15:12:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:38.857 15:12:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:38.857 15:12:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:38.857 15:12:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:38.857 15:12:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:38.857 15:12:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:38.857 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:38.857 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.118 nvme0n1 00:24:39.118 15:12:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.118 15:12:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:39.118 15:12:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:39.118 15:12:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.118 15:12:19 -- common/autotest_common.sh@10 -- # set +x 00:24:39.118 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.118 15:12:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:39.118 15:12:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:39.118 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.118 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.380 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.380 15:12:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:39.380 15:12:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:24:39.380 15:12:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:39.380 15:12:20 -- host/auth.sh@44 -- # digest=sha512 00:24:39.380 15:12:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:39.380 15:12:20 -- host/auth.sh@44 -- # keyid=1 00:24:39.380 15:12:20 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:39.380 15:12:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:39.380 15:12:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:39.380 15:12:20 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:39.380 15:12:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:24:39.380 15:12:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:39.380 15:12:20 -- host/auth.sh@68 -- # digest=sha512 00:24:39.380 15:12:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:39.380 15:12:20 -- host/auth.sh@68 -- # keyid=1 00:24:39.380 15:12:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:24:39.380 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.380 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.380 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.380 15:12:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:39.380 15:12:20 -- nvmf/common.sh@717 -- # local ip 00:24:39.380 15:12:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:39.380 15:12:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:39.380 15:12:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:39.380 15:12:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:39.380 15:12:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:39.380 15:12:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:39.380 15:12:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:39.380 15:12:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:39.380 15:12:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:39.380 15:12:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:39.380 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.380 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.380 nvme0n1 00:24:39.380 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.380 15:12:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:39.380 15:12:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:39.380 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.380 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.641 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.641 15:12:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:39.641 15:12:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:39.641 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.642 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.642 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.642 15:12:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:39.642 15:12:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:24:39.642 15:12:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:39.642 15:12:20 -- host/auth.sh@44 -- # digest=sha512 00:24:39.642 15:12:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:39.642 15:12:20 -- host/auth.sh@44 -- # keyid=2 00:24:39.642 15:12:20 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:39.642 15:12:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:39.642 15:12:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:39.642 15:12:20 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:39.642 15:12:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:24:39.642 15:12:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:39.642 15:12:20 -- host/auth.sh@68 -- # digest=sha512 00:24:39.642 15:12:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:39.642 15:12:20 -- host/auth.sh@68 -- # keyid=2 00:24:39.642 15:12:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:24:39.642 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.642 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.642 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.642 15:12:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:39.642 15:12:20 -- nvmf/common.sh@717 -- # local ip 00:24:39.642 15:12:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:39.642 15:12:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:39.642 15:12:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:39.642 15:12:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:39.642 15:12:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:39.642 15:12:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:39.642 15:12:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:39.642 15:12:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:39.642 15:12:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:39.642 15:12:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:39.642 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.642 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.903 nvme0n1 00:24:39.903 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.903 15:12:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:39.903 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.903 15:12:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:39.903 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.903 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.903 15:12:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:39.903 15:12:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:39.903 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.903 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.903 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.903 15:12:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:39.903 15:12:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:24:39.903 15:12:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:39.903 15:12:20 -- host/auth.sh@44 -- # digest=sha512 00:24:39.903 15:12:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:39.903 15:12:20 -- host/auth.sh@44 -- # keyid=3 00:24:39.903 15:12:20 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:39.903 15:12:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:39.903 15:12:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:39.903 15:12:20 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:39.903 15:12:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:24:39.903 15:12:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:39.903 15:12:20 -- host/auth.sh@68 -- # digest=sha512 00:24:39.903 15:12:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:39.903 15:12:20 -- host/auth.sh@68 -- # keyid=3 00:24:39.903 15:12:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:24:39.903 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.903 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:39.903 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:39.903 15:12:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:39.903 15:12:20 -- nvmf/common.sh@717 -- # local ip 00:24:39.903 15:12:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:39.903 15:12:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:39.903 15:12:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:39.903 15:12:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:39.903 15:12:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:39.903 15:12:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:39.903 15:12:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:39.903 15:12:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:39.903 15:12:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:39.903 15:12:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:39.903 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:39.903 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:40.164 nvme0n1 00:24:40.164 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.164 15:12:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:40.164 15:12:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:40.164 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.164 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:40.164 15:12:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.165 15:12:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:40.165 15:12:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:40.165 15:12:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.165 15:12:20 -- common/autotest_common.sh@10 -- # set +x 00:24:40.165 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.165 15:12:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:40.165 15:12:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:24:40.165 15:12:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:40.165 15:12:21 -- host/auth.sh@44 -- # digest=sha512 00:24:40.165 15:12:21 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:24:40.165 15:12:21 -- host/auth.sh@44 -- # keyid=4 00:24:40.165 15:12:21 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:40.165 15:12:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:40.165 15:12:21 -- host/auth.sh@48 -- # echo ffdhe3072 00:24:40.165 15:12:21 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:40.165 15:12:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:24:40.165 15:12:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:40.165 15:12:21 -- host/auth.sh@68 -- # digest=sha512 00:24:40.165 15:12:21 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:24:40.165 15:12:21 -- host/auth.sh@68 -- # keyid=4 00:24:40.165 15:12:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:24:40.165 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.165 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.165 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.165 15:12:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:40.165 15:12:21 -- nvmf/common.sh@717 -- # local ip 00:24:40.165 15:12:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:40.165 15:12:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:40.165 15:12:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:40.165 15:12:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:40.165 15:12:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:40.165 15:12:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:40.165 15:12:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:40.165 15:12:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:40.165 15:12:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:40.165 15:12:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:40.165 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.165 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.426 nvme0n1 00:24:40.426 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.426 15:12:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:40.426 15:12:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:40.426 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.426 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.426 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.426 15:12:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:40.426 15:12:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:40.426 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.426 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.426 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.426 15:12:21 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:40.426 15:12:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:40.426 15:12:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:24:40.426 15:12:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:40.426 15:12:21 -- host/auth.sh@44 -- # digest=sha512 00:24:40.426 15:12:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:40.426 15:12:21 -- host/auth.sh@44 -- # keyid=0 00:24:40.426 15:12:21 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:40.426 15:12:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:40.426 15:12:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:40.426 15:12:21 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:40.426 15:12:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:24:40.426 15:12:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:40.426 15:12:21 -- host/auth.sh@68 -- # digest=sha512 00:24:40.426 15:12:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:40.426 15:12:21 -- host/auth.sh@68 -- # keyid=0 00:24:40.426 15:12:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:24:40.426 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.426 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.426 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.426 15:12:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:40.426 15:12:21 -- nvmf/common.sh@717 -- # local ip 00:24:40.426 15:12:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:40.426 15:12:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:40.426 15:12:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:40.426 15:12:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:40.426 15:12:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:40.426 15:12:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:40.426 15:12:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:40.426 15:12:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:40.426 15:12:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:40.426 15:12:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:40.426 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.426 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.998 nvme0n1 00:24:40.998 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.998 15:12:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:40.998 15:12:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:40.998 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.998 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.998 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.998 15:12:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:40.999 15:12:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:40.999 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.999 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.999 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.999 15:12:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:40.999 15:12:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:24:40.999 15:12:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:40.999 15:12:21 -- host/auth.sh@44 -- # digest=sha512 00:24:40.999 15:12:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:40.999 15:12:21 -- host/auth.sh@44 -- # keyid=1 00:24:40.999 15:12:21 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:40.999 15:12:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:40.999 15:12:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:40.999 15:12:21 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:40.999 15:12:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:24:40.999 15:12:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:40.999 15:12:21 -- host/auth.sh@68 -- # digest=sha512 00:24:40.999 15:12:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:40.999 15:12:21 -- host/auth.sh@68 -- # keyid=1 00:24:40.999 15:12:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:24:40.999 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.999 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:40.999 15:12:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:40.999 15:12:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:40.999 15:12:21 -- nvmf/common.sh@717 -- # local ip 00:24:40.999 15:12:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:40.999 15:12:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:40.999 15:12:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:40.999 15:12:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:40.999 15:12:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:40.999 15:12:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:40.999 15:12:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:40.999 15:12:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:40.999 15:12:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:40.999 15:12:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:40.999 15:12:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:40.999 15:12:21 -- common/autotest_common.sh@10 -- # set +x 00:24:41.260 nvme0n1 00:24:41.260 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.260 15:12:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:41.260 15:12:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:41.260 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.260 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.260 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.260 15:12:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:41.260 15:12:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:41.260 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.260 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.260 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.260 15:12:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:41.260 15:12:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:24:41.260 15:12:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:41.260 15:12:22 -- host/auth.sh@44 -- # digest=sha512 00:24:41.260 15:12:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:41.260 15:12:22 -- host/auth.sh@44 -- # keyid=2 00:24:41.260 15:12:22 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:41.260 15:12:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:41.260 15:12:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:41.260 15:12:22 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:41.260 15:12:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:24:41.260 15:12:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:41.260 15:12:22 -- host/auth.sh@68 -- # digest=sha512 00:24:41.260 15:12:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:41.260 15:12:22 -- host/auth.sh@68 -- # keyid=2 00:24:41.260 15:12:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:24:41.260 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.260 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.260 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.260 15:12:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:41.260 15:12:22 -- nvmf/common.sh@717 -- # local ip 00:24:41.260 15:12:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:41.260 15:12:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:41.260 15:12:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:41.260 15:12:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:41.260 15:12:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:41.260 15:12:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:41.260 15:12:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:41.260 15:12:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:41.260 15:12:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:41.260 15:12:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:41.260 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.260 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.521 nvme0n1 00:24:41.521 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.521 15:12:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:41.521 15:12:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:41.521 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.521 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.521 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.521 15:12:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:41.522 15:12:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:41.522 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.522 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.782 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.782 15:12:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:41.782 15:12:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:24:41.782 15:12:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:41.782 15:12:22 -- host/auth.sh@44 -- # digest=sha512 00:24:41.782 15:12:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:41.782 15:12:22 -- host/auth.sh@44 -- # keyid=3 00:24:41.782 15:12:22 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:41.782 15:12:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:41.782 15:12:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:41.782 15:12:22 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:41.782 15:12:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:24:41.782 15:12:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:41.782 15:12:22 -- host/auth.sh@68 -- # digest=sha512 00:24:41.782 15:12:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:41.782 15:12:22 -- host/auth.sh@68 -- # keyid=3 00:24:41.782 15:12:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:24:41.782 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.782 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:41.782 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:41.782 15:12:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:41.782 15:12:22 -- nvmf/common.sh@717 -- # local ip 00:24:41.782 15:12:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:41.782 15:12:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:41.782 15:12:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:41.782 15:12:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:41.782 15:12:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:41.782 15:12:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:41.782 15:12:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:41.782 15:12:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:41.782 15:12:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:41.782 15:12:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:41.782 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:41.782 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:42.044 nvme0n1 00:24:42.044 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.044 15:12:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:42.044 15:12:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:42.044 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.044 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:42.044 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.044 15:12:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:42.044 15:12:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:42.044 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.044 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:42.044 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.044 15:12:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:42.044 15:12:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:24:42.044 15:12:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:42.044 15:12:22 -- host/auth.sh@44 -- # digest=sha512 00:24:42.044 15:12:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:24:42.044 15:12:22 -- host/auth.sh@44 -- # keyid=4 00:24:42.044 15:12:22 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:42.044 15:12:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:42.044 15:12:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:24:42.044 15:12:22 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:42.044 15:12:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:24:42.044 15:12:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:42.044 15:12:22 -- host/auth.sh@68 -- # digest=sha512 00:24:42.044 15:12:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:24:42.044 15:12:22 -- host/auth.sh@68 -- # keyid=4 00:24:42.044 15:12:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:24:42.044 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.044 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:42.044 15:12:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.044 15:12:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:42.044 15:12:22 -- nvmf/common.sh@717 -- # local ip 00:24:42.044 15:12:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:42.044 15:12:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:42.044 15:12:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:42.044 15:12:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:42.044 15:12:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:42.044 15:12:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:42.044 15:12:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:42.044 15:12:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:42.044 15:12:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:42.044 15:12:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:42.044 15:12:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.044 15:12:22 -- common/autotest_common.sh@10 -- # set +x 00:24:42.306 nvme0n1 00:24:42.306 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.306 15:12:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:42.306 15:12:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:42.306 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.306 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:42.306 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.306 15:12:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:42.306 15:12:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:42.306 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.306 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:42.566 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.566 15:12:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:42.566 15:12:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:42.566 15:12:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:24:42.566 15:12:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:42.566 15:12:23 -- host/auth.sh@44 -- # digest=sha512 00:24:42.566 15:12:23 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:42.566 15:12:23 -- host/auth.sh@44 -- # keyid=0 00:24:42.566 15:12:23 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:42.566 15:12:23 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:42.566 15:12:23 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:42.566 15:12:23 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:42.566 15:12:23 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:24:42.566 15:12:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:42.566 15:12:23 -- host/auth.sh@68 -- # digest=sha512 00:24:42.566 15:12:23 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:42.566 15:12:23 -- host/auth.sh@68 -- # keyid=0 00:24:42.566 15:12:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:24:42.566 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.566 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:42.566 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.566 15:12:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:42.566 15:12:23 -- nvmf/common.sh@717 -- # local ip 00:24:42.566 15:12:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:42.566 15:12:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:42.566 15:12:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:42.566 15:12:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:42.566 15:12:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:42.566 15:12:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:42.566 15:12:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:42.566 15:12:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:42.566 15:12:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:42.566 15:12:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:42.566 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.566 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:42.827 nvme0n1 00:24:42.827 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:42.827 15:12:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:42.827 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:42.827 15:12:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:42.827 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:42.827 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.087 15:12:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:43.087 15:12:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:43.087 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.087 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:43.087 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.087 15:12:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:43.088 15:12:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:24:43.088 15:12:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:43.088 15:12:23 -- host/auth.sh@44 -- # digest=sha512 00:24:43.088 15:12:23 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:43.088 15:12:23 -- host/auth.sh@44 -- # keyid=1 00:24:43.088 15:12:23 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:43.088 15:12:23 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:43.088 15:12:23 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:43.088 15:12:23 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:43.088 15:12:23 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:24:43.088 15:12:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:43.088 15:12:23 -- host/auth.sh@68 -- # digest=sha512 00:24:43.088 15:12:23 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:43.088 15:12:23 -- host/auth.sh@68 -- # keyid=1 00:24:43.088 15:12:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:24:43.088 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.088 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:43.088 15:12:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.088 15:12:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:43.088 15:12:23 -- nvmf/common.sh@717 -- # local ip 00:24:43.088 15:12:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:43.088 15:12:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:43.088 15:12:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:43.088 15:12:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:43.088 15:12:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:43.088 15:12:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:43.088 15:12:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:43.088 15:12:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:43.088 15:12:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:43.088 15:12:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:43.088 15:12:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.088 15:12:23 -- common/autotest_common.sh@10 -- # set +x 00:24:43.659 nvme0n1 00:24:43.659 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.659 15:12:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:43.659 15:12:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:43.659 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.659 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:43.659 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.659 15:12:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:43.659 15:12:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:43.659 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.659 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:43.659 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.659 15:12:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:43.659 15:12:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:24:43.659 15:12:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:43.659 15:12:24 -- host/auth.sh@44 -- # digest=sha512 00:24:43.659 15:12:24 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:43.659 15:12:24 -- host/auth.sh@44 -- # keyid=2 00:24:43.659 15:12:24 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:43.659 15:12:24 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:43.659 15:12:24 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:43.659 15:12:24 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:43.659 15:12:24 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:24:43.659 15:12:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:43.659 15:12:24 -- host/auth.sh@68 -- # digest=sha512 00:24:43.659 15:12:24 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:43.659 15:12:24 -- host/auth.sh@68 -- # keyid=2 00:24:43.659 15:12:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:24:43.659 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.659 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:43.659 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:43.659 15:12:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:43.659 15:12:24 -- nvmf/common.sh@717 -- # local ip 00:24:43.659 15:12:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:43.660 15:12:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:43.660 15:12:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:43.660 15:12:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:43.660 15:12:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:43.660 15:12:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:43.660 15:12:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:43.660 15:12:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:43.660 15:12:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:43.660 15:12:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:43.660 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:43.660 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:44.231 nvme0n1 00:24:44.231 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.231 15:12:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:44.231 15:12:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:44.231 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.231 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:44.231 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.231 15:12:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:44.231 15:12:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:44.231 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.231 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:44.231 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.231 15:12:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:44.231 15:12:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:24:44.231 15:12:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:44.231 15:12:24 -- host/auth.sh@44 -- # digest=sha512 00:24:44.231 15:12:24 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:44.231 15:12:24 -- host/auth.sh@44 -- # keyid=3 00:24:44.231 15:12:24 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:44.231 15:12:24 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:44.231 15:12:24 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:44.231 15:12:24 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:44.231 15:12:24 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:24:44.231 15:12:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:44.231 15:12:24 -- host/auth.sh@68 -- # digest=sha512 00:24:44.231 15:12:24 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:44.231 15:12:24 -- host/auth.sh@68 -- # keyid=3 00:24:44.231 15:12:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:24:44.231 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.231 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:44.232 15:12:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.232 15:12:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:44.232 15:12:24 -- nvmf/common.sh@717 -- # local ip 00:24:44.232 15:12:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:44.232 15:12:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:44.232 15:12:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:44.232 15:12:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:44.232 15:12:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:44.232 15:12:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:44.232 15:12:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:44.232 15:12:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:44.232 15:12:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:44.232 15:12:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:44.232 15:12:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.232 15:12:24 -- common/autotest_common.sh@10 -- # set +x 00:24:44.492 nvme0n1 00:24:44.492 15:12:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.492 15:12:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:44.492 15:12:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:44.492 15:12:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.492 15:12:25 -- common/autotest_common.sh@10 -- # set +x 00:24:44.753 15:12:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.753 15:12:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:44.753 15:12:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:44.753 15:12:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.753 15:12:25 -- common/autotest_common.sh@10 -- # set +x 00:24:44.753 15:12:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.753 15:12:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:44.753 15:12:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:24:44.753 15:12:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:44.753 15:12:25 -- host/auth.sh@44 -- # digest=sha512 00:24:44.753 15:12:25 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:24:44.753 15:12:25 -- host/auth.sh@44 -- # keyid=4 00:24:44.753 15:12:25 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:44.753 15:12:25 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:44.753 15:12:25 -- host/auth.sh@48 -- # echo ffdhe6144 00:24:44.753 15:12:25 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:44.753 15:12:25 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:24:44.753 15:12:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:44.753 15:12:25 -- host/auth.sh@68 -- # digest=sha512 00:24:44.753 15:12:25 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:24:44.753 15:12:25 -- host/auth.sh@68 -- # keyid=4 00:24:44.753 15:12:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:24:44.753 15:12:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.753 15:12:25 -- common/autotest_common.sh@10 -- # set +x 00:24:44.753 15:12:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:44.754 15:12:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:44.754 15:12:25 -- nvmf/common.sh@717 -- # local ip 00:24:44.754 15:12:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:44.754 15:12:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:44.754 15:12:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:44.754 15:12:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:44.754 15:12:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:44.754 15:12:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:44.754 15:12:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:44.754 15:12:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:44.754 15:12:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:44.754 15:12:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:44.754 15:12:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:44.754 15:12:25 -- common/autotest_common.sh@10 -- # set +x 00:24:45.326 nvme0n1 00:24:45.326 15:12:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:45.326 15:12:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:45.326 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:45.326 15:12:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:45.326 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.326 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:45.326 15:12:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:45.326 15:12:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:45.326 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:45.326 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.326 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:45.326 15:12:26 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:24:45.326 15:12:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:45.326 15:12:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:24:45.326 15:12:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:45.326 15:12:26 -- host/auth.sh@44 -- # digest=sha512 00:24:45.326 15:12:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:45.326 15:12:26 -- host/auth.sh@44 -- # keyid=0 00:24:45.326 15:12:26 -- host/auth.sh@45 -- # key=DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:45.326 15:12:26 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:45.326 15:12:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:45.326 15:12:26 -- host/auth.sh@49 -- # echo DHHC-1:00:YzJmNmU2M2NiODhkYzI2MTIzMzhmZDVjZDgzZmE1ZjL0P0E0: 00:24:45.326 15:12:26 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:24:45.326 15:12:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:45.326 15:12:26 -- host/auth.sh@68 -- # digest=sha512 00:24:45.326 15:12:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:45.326 15:12:26 -- host/auth.sh@68 -- # keyid=0 00:24:45.326 15:12:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:24:45.326 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:45.326 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.326 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:45.326 15:12:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:45.326 15:12:26 -- nvmf/common.sh@717 -- # local ip 00:24:45.326 15:12:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:45.326 15:12:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:45.326 15:12:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:45.326 15:12:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:45.326 15:12:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:45.326 15:12:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:45.326 15:12:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:45.326 15:12:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:45.326 15:12:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:45.326 15:12:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:24:45.326 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:45.326 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.898 nvme0n1 00:24:45.898 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:46.160 15:12:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:46.160 15:12:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:46.160 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:46.160 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:46.160 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:46.160 15:12:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:46.160 15:12:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:46.160 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:46.160 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:46.160 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:46.160 15:12:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:46.160 15:12:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:24:46.160 15:12:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:46.160 15:12:26 -- host/auth.sh@44 -- # digest=sha512 00:24:46.160 15:12:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:46.160 15:12:26 -- host/auth.sh@44 -- # keyid=1 00:24:46.160 15:12:26 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:46.160 15:12:26 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:46.160 15:12:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:46.160 15:12:26 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:46.160 15:12:26 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:24:46.160 15:12:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:46.160 15:12:26 -- host/auth.sh@68 -- # digest=sha512 00:24:46.160 15:12:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:46.160 15:12:26 -- host/auth.sh@68 -- # keyid=1 00:24:46.160 15:12:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:24:46.160 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:46.160 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:46.160 15:12:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:46.160 15:12:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:46.160 15:12:26 -- nvmf/common.sh@717 -- # local ip 00:24:46.160 15:12:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:46.160 15:12:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:46.160 15:12:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:46.160 15:12:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:46.160 15:12:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:46.160 15:12:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:46.160 15:12:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:46.160 15:12:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:46.160 15:12:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:46.160 15:12:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:24:46.160 15:12:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:46.160 15:12:26 -- common/autotest_common.sh@10 -- # set +x 00:24:47.104 nvme0n1 00:24:47.104 15:12:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.104 15:12:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:47.104 15:12:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:47.104 15:12:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.104 15:12:27 -- common/autotest_common.sh@10 -- # set +x 00:24:47.104 15:12:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.104 15:12:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:47.104 15:12:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:47.104 15:12:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.104 15:12:27 -- common/autotest_common.sh@10 -- # set +x 00:24:47.104 15:12:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.104 15:12:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:47.104 15:12:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:24:47.104 15:12:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:47.104 15:12:27 -- host/auth.sh@44 -- # digest=sha512 00:24:47.104 15:12:27 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:47.104 15:12:27 -- host/auth.sh@44 -- # keyid=2 00:24:47.104 15:12:27 -- host/auth.sh@45 -- # key=DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:47.104 15:12:27 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:47.104 15:12:27 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:47.104 15:12:27 -- host/auth.sh@49 -- # echo DHHC-1:01:YmJhNWQ5MTI5MzljOWFkZWQ0YjFiYThlZjJkMGIxNzm/qoXS: 00:24:47.104 15:12:27 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:24:47.104 15:12:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:47.104 15:12:27 -- host/auth.sh@68 -- # digest=sha512 00:24:47.104 15:12:27 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:47.104 15:12:27 -- host/auth.sh@68 -- # keyid=2 00:24:47.104 15:12:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:24:47.104 15:12:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.104 15:12:27 -- common/autotest_common.sh@10 -- # set +x 00:24:47.104 15:12:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.104 15:12:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:47.104 15:12:27 -- nvmf/common.sh@717 -- # local ip 00:24:47.104 15:12:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:47.104 15:12:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:47.104 15:12:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:47.104 15:12:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:47.104 15:12:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:47.104 15:12:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:47.104 15:12:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:47.104 15:12:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:47.104 15:12:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:47.104 15:12:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:47.104 15:12:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.104 15:12:27 -- common/autotest_common.sh@10 -- # set +x 00:24:47.677 nvme0n1 00:24:47.677 15:12:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.677 15:12:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:47.677 15:12:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:47.677 15:12:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.677 15:12:28 -- common/autotest_common.sh@10 -- # set +x 00:24:47.677 15:12:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.677 15:12:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:47.677 15:12:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:47.677 15:12:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.677 15:12:28 -- common/autotest_common.sh@10 -- # set +x 00:24:47.677 15:12:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.677 15:12:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:47.677 15:12:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:24:47.677 15:12:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:47.677 15:12:28 -- host/auth.sh@44 -- # digest=sha512 00:24:47.677 15:12:28 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:47.677 15:12:28 -- host/auth.sh@44 -- # keyid=3 00:24:47.677 15:12:28 -- host/auth.sh@45 -- # key=DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:47.677 15:12:28 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:47.677 15:12:28 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:47.677 15:12:28 -- host/auth.sh@49 -- # echo DHHC-1:02:NTNiNDRhY2M1NDFhZTAyOGVhNjkyODRhOWI1ZjFjMWQ2NjU2OTIzMjY4OGYyZWYyMPQL7Q==: 00:24:47.677 15:12:28 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:24:47.677 15:12:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:47.677 15:12:28 -- host/auth.sh@68 -- # digest=sha512 00:24:47.677 15:12:28 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:47.677 15:12:28 -- host/auth.sh@68 -- # keyid=3 00:24:47.677 15:12:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:24:47.677 15:12:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.677 15:12:28 -- common/autotest_common.sh@10 -- # set +x 00:24:47.938 15:12:28 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:47.938 15:12:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:47.938 15:12:28 -- nvmf/common.sh@717 -- # local ip 00:24:47.938 15:12:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:47.938 15:12:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:47.938 15:12:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:47.938 15:12:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:47.938 15:12:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:47.938 15:12:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:47.938 15:12:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:47.938 15:12:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:47.938 15:12:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:47.938 15:12:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:24:47.938 15:12:28 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:47.938 15:12:28 -- common/autotest_common.sh@10 -- # set +x 00:24:48.510 nvme0n1 00:24:48.510 15:12:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:48.510 15:12:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:48.510 15:12:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:48.510 15:12:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:48.510 15:12:29 -- common/autotest_common.sh@10 -- # set +x 00:24:48.510 15:12:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:48.510 15:12:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:48.510 15:12:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:48.510 15:12:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:48.510 15:12:29 -- common/autotest_common.sh@10 -- # set +x 00:24:48.772 15:12:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:48.772 15:12:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:24:48.772 15:12:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:24:48.772 15:12:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:48.772 15:12:29 -- host/auth.sh@44 -- # digest=sha512 00:24:48.772 15:12:29 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:24:48.772 15:12:29 -- host/auth.sh@44 -- # keyid=4 00:24:48.772 15:12:29 -- host/auth.sh@45 -- # key=DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:48.772 15:12:29 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:24:48.772 15:12:29 -- host/auth.sh@48 -- # echo ffdhe8192 00:24:48.772 15:12:29 -- host/auth.sh@49 -- # echo DHHC-1:03:ZGM0YWMyNGQzOGM5M2RkOWY1ZGQ2YjNlYTEyNzExYmEyNjQ2YmM0YmY4YWFjNzBmMzhkNWI3MDg5ODZjNzZmMdsJGfo=: 00:24:48.772 15:12:29 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:24:48.772 15:12:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:24:48.772 15:12:29 -- host/auth.sh@68 -- # digest=sha512 00:24:48.772 15:12:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:24:48.772 15:12:29 -- host/auth.sh@68 -- # keyid=4 00:24:48.772 15:12:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:24:48.772 15:12:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:48.772 15:12:29 -- common/autotest_common.sh@10 -- # set +x 00:24:48.772 15:12:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:48.772 15:12:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:24:48.772 15:12:29 -- nvmf/common.sh@717 -- # local ip 00:24:48.772 15:12:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:48.772 15:12:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:48.772 15:12:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:48.772 15:12:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:48.772 15:12:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:48.772 15:12:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:48.772 15:12:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:48.772 15:12:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:48.772 15:12:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:48.772 15:12:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:24:48.772 15:12:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:48.772 15:12:29 -- common/autotest_common.sh@10 -- # set +x 00:24:49.344 nvme0n1 00:24:49.344 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.344 15:12:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:24:49.344 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.344 15:12:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:24:49.344 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.344 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.606 15:12:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:24:49.606 15:12:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:49.606 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.606 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.606 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.606 15:12:30 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:24:49.606 15:12:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:24:49.606 15:12:30 -- host/auth.sh@44 -- # digest=sha256 00:24:49.606 15:12:30 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:24:49.606 15:12:30 -- host/auth.sh@44 -- # keyid=1 00:24:49.606 15:12:30 -- host/auth.sh@45 -- # key=DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:49.606 15:12:30 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:24:49.606 15:12:30 -- host/auth.sh@48 -- # echo ffdhe2048 00:24:49.606 15:12:30 -- host/auth.sh@49 -- # echo DHHC-1:00:NGFiNWYyNWU3YTM3YzE2Yzc3ZmE3NmE5ZWUxMGQzZTAyMjI5M2Y3YTIxYjg4N2Ri5VlHlQ==: 00:24:49.606 15:12:30 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:24:49.606 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.607 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.607 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.607 15:12:30 -- host/auth.sh@119 -- # get_main_ns_ip 00:24:49.607 15:12:30 -- nvmf/common.sh@717 -- # local ip 00:24:49.607 15:12:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:49.607 15:12:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:49.607 15:12:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:49.607 15:12:30 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:24:49.607 15:12:30 -- common/autotest_common.sh@648 -- # local es=0 00:24:49.607 15:12:30 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:24:49.607 15:12:30 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:24:49.607 15:12:30 -- common/autotest_common.sh@651 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:24:49.607 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.607 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.607 request: 00:24:49.607 { 00:24:49.607 "name": "nvme0", 00:24:49.607 "trtype": "rdma", 00:24:49.607 "traddr": "192.168.100.8", 00:24:49.607 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:24:49.607 "adrfam": "ipv4", 00:24:49.607 "trsvcid": "4420", 00:24:49.607 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:24:49.607 "method": "bdev_nvme_attach_controller", 00:24:49.607 "req_id": 1 00:24:49.607 } 00:24:49.607 Got JSON-RPC error response 00:24:49.607 response: 00:24:49.607 { 00:24:49.607 "code": -32602, 00:24:49.607 "message": "Invalid parameters" 00:24:49.607 } 00:24:49.607 15:12:30 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:24:49.607 15:12:30 -- common/autotest_common.sh@651 -- # es=1 00:24:49.607 15:12:30 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:24:49.607 15:12:30 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:24:49.607 15:12:30 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:24:49.607 15:12:30 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:24:49.607 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.607 15:12:30 -- host/auth.sh@121 -- # jq length 00:24:49.607 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.607 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.607 15:12:30 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:24:49.607 15:12:30 -- host/auth.sh@124 -- # get_main_ns_ip 00:24:49.607 15:12:30 -- nvmf/common.sh@717 -- # local ip 00:24:49.607 15:12:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:24:49.607 15:12:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:24:49.607 15:12:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:24:49.607 15:12:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:24:49.607 15:12:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:24:49.607 15:12:30 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:49.607 15:12:30 -- common/autotest_common.sh@648 -- # local es=0 00:24:49.607 15:12:30 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:49.607 15:12:30 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:24:49.607 15:12:30 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:24:49.607 15:12:30 -- common/autotest_common.sh@651 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:24:49.607 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.607 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.868 request: 00:24:49.868 { 00:24:49.868 "name": "nvme0", 00:24:49.868 "trtype": "rdma", 00:24:49.868 "traddr": "192.168.100.8", 00:24:49.868 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:24:49.868 "adrfam": "ipv4", 00:24:49.868 "trsvcid": "4420", 00:24:49.868 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:24:49.868 "dhchap_key": "key2", 00:24:49.868 "method": "bdev_nvme_attach_controller", 00:24:49.868 "req_id": 1 00:24:49.868 } 00:24:49.868 Got JSON-RPC error response 00:24:49.868 response: 00:24:49.868 { 00:24:49.868 "code": -32602, 00:24:49.868 "message": "Invalid parameters" 00:24:49.869 } 00:24:49.869 15:12:30 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:24:49.869 15:12:30 -- common/autotest_common.sh@651 -- # es=1 00:24:49.869 15:12:30 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:24:49.869 15:12:30 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:24:49.869 15:12:30 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:24:49.869 15:12:30 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:24:49.869 15:12:30 -- common/autotest_common.sh@559 -- # xtrace_disable 00:24:49.869 15:12:30 -- host/auth.sh@127 -- # jq length 00:24:49.869 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:24:49.869 15:12:30 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:24:49.869 15:12:30 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:24:49.869 15:12:30 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:24:49.869 15:12:30 -- host/auth.sh@130 -- # cleanup 00:24:49.869 15:12:30 -- host/auth.sh@24 -- # nvmftestfini 00:24:49.869 15:12:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:24:49.869 15:12:30 -- nvmf/common.sh@117 -- # sync 00:24:49.869 15:12:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:24:49.869 15:12:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:24:49.869 15:12:30 -- nvmf/common.sh@120 -- # set +e 00:24:49.869 15:12:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:24:49.869 15:12:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:24:49.869 rmmod nvme_rdma 00:24:49.869 rmmod nvme_fabrics 00:24:49.869 15:12:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:24:49.869 15:12:30 -- nvmf/common.sh@124 -- # set -e 00:24:49.869 15:12:30 -- nvmf/common.sh@125 -- # return 0 00:24:49.869 15:12:30 -- nvmf/common.sh@478 -- # '[' -n 3634610 ']' 00:24:49.869 15:12:30 -- nvmf/common.sh@479 -- # killprocess 3634610 00:24:49.869 15:12:30 -- common/autotest_common.sh@946 -- # '[' -z 3634610 ']' 00:24:49.869 15:12:30 -- common/autotest_common.sh@950 -- # kill -0 3634610 00:24:49.869 15:12:30 -- common/autotest_common.sh@951 -- # uname 00:24:49.869 15:12:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:24:49.869 15:12:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3634610 00:24:49.869 15:12:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:24:49.869 15:12:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:24:49.869 15:12:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3634610' 00:24:49.869 killing process with pid 3634610 00:24:49.869 15:12:30 -- common/autotest_common.sh@965 -- # kill 3634610 00:24:49.869 15:12:30 -- common/autotest_common.sh@970 -- # wait 3634610 00:24:50.130 15:12:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:24:50.130 15:12:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:24:50.130 15:12:30 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:24:50.130 15:12:30 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:24:50.130 15:12:30 -- host/auth.sh@27 -- # clean_kernel_target 00:24:50.130 15:12:30 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:24:50.130 15:12:30 -- nvmf/common.sh@675 -- # echo 0 00:24:50.130 15:12:30 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:24:50.130 15:12:30 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:24:50.130 15:12:30 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:24:50.130 15:12:30 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:24:50.130 15:12:30 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:24:50.130 15:12:30 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:24:50.130 15:12:30 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:24:52.673 0000:80:01.6 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.7 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.4 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.5 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.2 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.3 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.0 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:80:01.1 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.6 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.7 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.4 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.5 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.2 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.3 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.0 (8086 0b00): ioatdma -> vfio-pci 00:24:52.673 0000:00:01.1 (8086 0b00): ioatdma -> vfio-pci 00:24:52.934 0000:65:00.0 (144d a80a): nvme -> vfio-pci 00:24:52.934 15:12:33 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.xnE /tmp/spdk.key-null.JUv /tmp/spdk.key-sha256.OOC /tmp/spdk.key-sha384.VdI /tmp/spdk.key-sha512.hwA /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:24:52.934 15:12:33 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:24:55.481 0000:80:01.6 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.7 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.4 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.5 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.2 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.3 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.0 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:80:01.1 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.6 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:65:00.0 (144d a80a): Already using the vfio-pci driver 00:24:55.481 0000:00:01.7 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.4 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.5 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.2 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.3 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.0 (8086 0b00): Already using the vfio-pci driver 00:24:55.481 0000:00:01.1 (8086 0b00): Already using the vfio-pci driver 00:24:55.743 00:24:55.743 real 0m56.523s 00:24:55.743 user 0m48.358s 00:24:55.743 sys 0m13.822s 00:24:55.743 15:12:36 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:24:55.743 15:12:36 -- common/autotest_common.sh@10 -- # set +x 00:24:55.743 ************************************ 00:24:55.743 END TEST nvmf_auth 00:24:55.743 ************************************ 00:24:55.743 15:12:36 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:24:55.743 15:12:36 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:24:55.743 15:12:36 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:24:55.743 15:12:36 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:24:55.743 15:12:36 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:24:55.743 15:12:36 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:24:55.743 15:12:36 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:24:55.743 15:12:36 -- common/autotest_common.sh@10 -- # set +x 00:24:55.743 ************************************ 00:24:55.743 START TEST nvmf_bdevperf 00:24:55.743 ************************************ 00:24:55.743 15:12:36 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:24:56.004 * Looking for test storage... 00:24:56.004 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:24:56.004 15:12:36 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:24:56.004 15:12:36 -- nvmf/common.sh@7 -- # uname -s 00:24:56.004 15:12:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:56.004 15:12:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:56.004 15:12:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:56.004 15:12:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:56.004 15:12:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:56.004 15:12:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:56.004 15:12:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:56.004 15:12:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:56.004 15:12:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:56.004 15:12:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:56.004 15:12:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:56.004 15:12:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:24:56.004 15:12:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:56.004 15:12:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:56.004 15:12:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:56.004 15:12:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:24:56.004 15:12:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:24:56.004 15:12:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:56.004 15:12:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:56.004 15:12:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:56.004 15:12:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.004 15:12:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.004 15:12:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.004 15:12:36 -- paths/export.sh@5 -- # export PATH 00:24:56.004 15:12:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:56.004 15:12:36 -- nvmf/common.sh@47 -- # : 0 00:24:56.004 15:12:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:24:56.004 15:12:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:24:56.004 15:12:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:24:56.004 15:12:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:56.004 15:12:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:56.004 15:12:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:24:56.004 15:12:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:24:56.004 15:12:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:24:56.004 15:12:36 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:56.004 15:12:36 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:56.004 15:12:36 -- host/bdevperf.sh@24 -- # nvmftestinit 00:24:56.004 15:12:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:24:56.004 15:12:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:56.004 15:12:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:24:56.004 15:12:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:24:56.004 15:12:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:24:56.004 15:12:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.004 15:12:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.004 15:12:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.004 15:12:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:24:56.004 15:12:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:24:56.004 15:12:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:24:56.004 15:12:36 -- common/autotest_common.sh@10 -- # set +x 00:25:02.720 15:12:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:02.720 15:12:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:02.720 15:12:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:02.720 15:12:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:02.720 15:12:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:02.720 15:12:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:02.720 15:12:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:02.720 15:12:43 -- nvmf/common.sh@295 -- # net_devs=() 00:25:02.720 15:12:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:02.720 15:12:43 -- nvmf/common.sh@296 -- # e810=() 00:25:02.720 15:12:43 -- nvmf/common.sh@296 -- # local -ga e810 00:25:02.720 15:12:43 -- nvmf/common.sh@297 -- # x722=() 00:25:02.720 15:12:43 -- nvmf/common.sh@297 -- # local -ga x722 00:25:02.720 15:12:43 -- nvmf/common.sh@298 -- # mlx=() 00:25:02.720 15:12:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:02.720 15:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:02.720 15:12:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:25:02.720 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:25:02.720 15:12:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:02.720 15:12:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:25:02.720 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:25:02.720 15:12:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:02.720 15:12:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.720 15:12:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.720 15:12:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:25:02.720 Found net devices under 0000:31:00.0: mlx_0_0 00:25:02.720 15:12:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:02.720 15:12:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:02.720 15:12:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:25:02.720 Found net devices under 0000:31:00.1: mlx_0_1 00:25:02.720 15:12:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:02.720 15:12:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:02.720 15:12:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:02.720 15:12:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:02.720 15:12:43 -- nvmf/common.sh@58 -- # uname 00:25:02.720 15:12:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:02.720 15:12:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:02.720 15:12:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:02.720 15:12:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:02.720 15:12:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:02.720 15:12:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:02.720 15:12:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:02.720 15:12:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:02.720 15:12:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:02.720 15:12:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:02.720 15:12:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:02.720 15:12:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:02.720 15:12:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:02.720 15:12:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:02.720 15:12:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:02.720 15:12:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:02.720 15:12:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:02.720 15:12:43 -- nvmf/common.sh@105 -- # continue 2 00:25:02.720 15:12:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.720 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:02.720 15:12:43 -- nvmf/common.sh@105 -- # continue 2 00:25:02.720 15:12:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:02.720 15:12:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:25:02.720 15:12:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:02.720 15:12:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:02.720 15:12:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:02.720 15:12:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:02.720 15:12:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:02.720 15:12:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:02.720 15:12:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:25:02.720 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:02.720 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:25:02.720 altname enp49s0f0np0 00:25:02.720 altname ens786f0np0 00:25:02.720 inet 192.168.100.8/24 scope global mlx_0_0 00:25:02.720 valid_lft forever preferred_lft forever 00:25:02.720 15:12:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:02.720 15:12:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:25:02.720 15:12:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:02.720 15:12:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:02.720 15:12:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:02.721 15:12:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:02.721 15:12:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:02.721 15:12:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:25:02.721 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:02.721 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:25:02.721 altname enp49s0f1np1 00:25:02.721 altname ens786f1np1 00:25:02.721 inet 192.168.100.9/24 scope global mlx_0_1 00:25:02.721 valid_lft forever preferred_lft forever 00:25:02.721 15:12:43 -- nvmf/common.sh@411 -- # return 0 00:25:02.721 15:12:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:02.721 15:12:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:02.721 15:12:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:02.721 15:12:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:02.721 15:12:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:02.721 15:12:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:02.721 15:12:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:02.721 15:12:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:02.721 15:12:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:02.721 15:12:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:02.721 15:12:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:02.721 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.721 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:02.721 15:12:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:02.721 15:12:43 -- nvmf/common.sh@105 -- # continue 2 00:25:02.721 15:12:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:02.721 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.721 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:02.721 15:12:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:02.721 15:12:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:02.721 15:12:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:02.721 15:12:43 -- nvmf/common.sh@105 -- # continue 2 00:25:02.721 15:12:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:02.721 15:12:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:25:02.721 15:12:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:02.721 15:12:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:02.721 15:12:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:25:02.721 15:12:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:02.721 15:12:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:02.721 15:12:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:02.721 192.168.100.9' 00:25:02.721 15:12:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:02.721 192.168.100.9' 00:25:02.721 15:12:43 -- nvmf/common.sh@446 -- # head -n 1 00:25:02.721 15:12:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:02.721 15:12:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:02.721 192.168.100.9' 00:25:02.721 15:12:43 -- nvmf/common.sh@447 -- # tail -n +2 00:25:02.721 15:12:43 -- nvmf/common.sh@447 -- # head -n 1 00:25:02.721 15:12:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:02.721 15:12:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:02.721 15:12:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:02.721 15:12:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:02.721 15:12:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:02.721 15:12:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:02.721 15:12:43 -- host/bdevperf.sh@25 -- # tgt_init 00:25:02.721 15:12:43 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:25:02.721 15:12:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:02.721 15:12:43 -- common/autotest_common.sh@720 -- # xtrace_disable 00:25:02.721 15:12:43 -- common/autotest_common.sh@10 -- # set +x 00:25:02.721 15:12:43 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:02.721 15:12:43 -- nvmf/common.sh@470 -- # nvmfpid=3651386 00:25:02.721 15:12:43 -- nvmf/common.sh@471 -- # waitforlisten 3651386 00:25:02.721 15:12:43 -- common/autotest_common.sh@827 -- # '[' -z 3651386 ']' 00:25:02.721 15:12:43 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:02.721 15:12:43 -- common/autotest_common.sh@832 -- # local max_retries=100 00:25:02.721 15:12:43 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:02.721 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:02.721 15:12:43 -- common/autotest_common.sh@836 -- # xtrace_disable 00:25:02.721 15:12:43 -- common/autotest_common.sh@10 -- # set +x 00:25:02.721 [2024-04-26 15:12:43.286660] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:02.721 [2024-04-26 15:12:43.286725] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:02.721 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.721 [2024-04-26 15:12:43.350160] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:02.721 [2024-04-26 15:12:43.414348] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:02.721 [2024-04-26 15:12:43.414382] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:02.721 [2024-04-26 15:12:43.414390] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:02.721 [2024-04-26 15:12:43.414396] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:02.721 [2024-04-26 15:12:43.414401] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:02.721 [2024-04-26 15:12:43.414544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:02.721 [2024-04-26 15:12:43.414683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:02.721 [2024-04-26 15:12:43.414686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:03.293 15:12:44 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:25:03.293 15:12:44 -- common/autotest_common.sh@860 -- # return 0 00:25:03.293 15:12:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:03.293 15:12:44 -- common/autotest_common.sh@726 -- # xtrace_disable 00:25:03.293 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.293 15:12:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:03.293 15:12:44 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:25:03.293 15:12:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:03.293 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.293 [2024-04-26 15:12:44.148519] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x76a2f0/0x76e7e0) succeed. 00:25:03.293 [2024-04-26 15:12:44.162028] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x76b890/0x7afe70) succeed. 00:25:03.554 15:12:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:03.554 15:12:44 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:03.554 15:12:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:03.554 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.554 Malloc0 00:25:03.554 15:12:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:03.554 15:12:44 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:03.554 15:12:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:03.554 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.554 15:12:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:03.554 15:12:44 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:03.554 15:12:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:03.554 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.554 15:12:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:03.554 15:12:44 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:03.554 15:12:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:03.554 15:12:44 -- common/autotest_common.sh@10 -- # set +x 00:25:03.554 [2024-04-26 15:12:44.316504] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:03.554 15:12:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:03.554 15:12:44 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:25:03.554 15:12:44 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:25:03.554 15:12:44 -- nvmf/common.sh@521 -- # config=() 00:25:03.554 15:12:44 -- nvmf/common.sh@521 -- # local subsystem config 00:25:03.554 15:12:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:25:03.554 15:12:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:25:03.554 { 00:25:03.554 "params": { 00:25:03.554 "name": "Nvme$subsystem", 00:25:03.554 "trtype": "$TEST_TRANSPORT", 00:25:03.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:03.554 "adrfam": "ipv4", 00:25:03.554 "trsvcid": "$NVMF_PORT", 00:25:03.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:03.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:03.554 "hdgst": ${hdgst:-false}, 00:25:03.554 "ddgst": ${ddgst:-false} 00:25:03.554 }, 00:25:03.554 "method": "bdev_nvme_attach_controller" 00:25:03.554 } 00:25:03.554 EOF 00:25:03.554 )") 00:25:03.554 15:12:44 -- nvmf/common.sh@543 -- # cat 00:25:03.554 15:12:44 -- nvmf/common.sh@545 -- # jq . 00:25:03.554 15:12:44 -- nvmf/common.sh@546 -- # IFS=, 00:25:03.554 15:12:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:25:03.554 "params": { 00:25:03.554 "name": "Nvme1", 00:25:03.554 "trtype": "rdma", 00:25:03.554 "traddr": "192.168.100.8", 00:25:03.554 "adrfam": "ipv4", 00:25:03.554 "trsvcid": "4420", 00:25:03.554 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:03.554 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:03.554 "hdgst": false, 00:25:03.554 "ddgst": false 00:25:03.554 }, 00:25:03.554 "method": "bdev_nvme_attach_controller" 00:25:03.554 }' 00:25:03.554 [2024-04-26 15:12:44.378792] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:03.554 [2024-04-26 15:12:44.378850] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3651503 ] 00:25:03.554 EAL: No free 2048 kB hugepages reported on node 1 00:25:03.554 [2024-04-26 15:12:44.437793] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:03.554 [2024-04-26 15:12:44.500808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:03.815 Running I/O for 1 seconds... 00:25:04.758 00:25:04.758 Latency(us) 00:25:04.758 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:04.758 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:04.758 Verification LBA range: start 0x0 length 0x4000 00:25:04.758 Nvme1n1 : 1.01 14558.03 56.87 0.00 0.00 8729.12 1392.64 13817.17 00:25:04.758 =================================================================================================================== 00:25:04.758 Total : 14558.03 56.87 0.00 0.00 8729.12 1392.64 13817.17 00:25:05.020 15:12:45 -- host/bdevperf.sh@30 -- # bdevperfpid=3651763 00:25:05.020 15:12:45 -- host/bdevperf.sh@32 -- # sleep 3 00:25:05.020 15:12:45 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:25:05.020 15:12:45 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:25:05.020 15:12:45 -- nvmf/common.sh@521 -- # config=() 00:25:05.020 15:12:45 -- nvmf/common.sh@521 -- # local subsystem config 00:25:05.020 15:12:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:25:05.020 15:12:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:25:05.020 { 00:25:05.020 "params": { 00:25:05.020 "name": "Nvme$subsystem", 00:25:05.020 "trtype": "$TEST_TRANSPORT", 00:25:05.020 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.020 "adrfam": "ipv4", 00:25:05.020 "trsvcid": "$NVMF_PORT", 00:25:05.020 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.020 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.020 "hdgst": ${hdgst:-false}, 00:25:05.020 "ddgst": ${ddgst:-false} 00:25:05.020 }, 00:25:05.020 "method": "bdev_nvme_attach_controller" 00:25:05.020 } 00:25:05.020 EOF 00:25:05.020 )") 00:25:05.020 15:12:45 -- nvmf/common.sh@543 -- # cat 00:25:05.020 15:12:45 -- nvmf/common.sh@545 -- # jq . 00:25:05.020 15:12:45 -- nvmf/common.sh@546 -- # IFS=, 00:25:05.020 15:12:45 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:25:05.020 "params": { 00:25:05.020 "name": "Nvme1", 00:25:05.020 "trtype": "rdma", 00:25:05.020 "traddr": "192.168.100.8", 00:25:05.020 "adrfam": "ipv4", 00:25:05.020 "trsvcid": "4420", 00:25:05.020 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:05.020 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:05.020 "hdgst": false, 00:25:05.020 "ddgst": false 00:25:05.020 }, 00:25:05.020 "method": "bdev_nvme_attach_controller" 00:25:05.020 }' 00:25:05.020 [2024-04-26 15:12:45.886498] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:05.020 [2024-04-26 15:12:45.886556] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3651763 ] 00:25:05.020 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.020 [2024-04-26 15:12:45.945288] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:05.281 [2024-04-26 15:12:46.007557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:05.281 Running I/O for 15 seconds... 00:25:08.585 15:12:48 -- host/bdevperf.sh@33 -- # kill -9 3651386 00:25:08.585 15:12:48 -- host/bdevperf.sh@35 -- # sleep 3 00:25:09.159 [2024-04-26 15:12:49.869289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:95768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:95776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:95784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:95792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:95800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:95808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:95816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:95824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:95832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:95840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:95848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:95856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:95864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:95872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:95880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:95888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:95896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:95904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:95912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:95920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:95928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.159 [2024-04-26 15:12:49.869674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.159 [2024-04-26 15:12:49.869685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:95936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:95944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:95952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:95960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:95968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:95976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:95984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:95992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:96000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:96008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:96016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:96024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:96032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:96040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:96048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:96056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:96064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:96072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:96080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.869990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.869999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:96088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:96096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:96104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:96112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:96120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:96128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:96136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:96144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:96152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:96160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:96168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:96176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:96184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:96192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:96200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:96208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:96216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:96224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:96232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:96240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.160 [2024-04-26 15:12:49.870331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:96248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:09.160 [2024-04-26 15:12:49.870338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:95232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:95240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:95248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:95256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:95264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:95272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:95280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:95288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:95296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:95304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:95312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:95320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:95328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:95336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:95344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:95352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:95360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:95368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:95376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:95384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:95392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:95400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:95408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:95416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:95424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:95432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:95440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:95448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:95456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:95464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:95472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:95480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:95488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:95496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:95504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:95512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x18cd00 00:25:09.161 [2024-04-26 15:12:49.870942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.161 [2024-04-26 15:12:49.870951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:95520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.870958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.870968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:95528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.870975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.870984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:95536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.870992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:95544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:95552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:95560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:95568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:95576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:95584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:95592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:95600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:95608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:95616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:95624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:95632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:95640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:95648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:95656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:95664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:95672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:95680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:95688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:95696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:95704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:95712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:95720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:95728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:95736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:95744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.871439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:95752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x18cd00 00:25:09.162 [2024-04-26 15:12:49.871446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.873471] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:09.162 [2024-04-26 15:12:49.873482] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:09.162 [2024-04-26 15:12:49.873490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:95760 len:8 PRP1 0x0 PRP2 0x0 00:25:09.162 [2024-04-26 15:12:49.873497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.162 [2024-04-26 15:12:49.873529] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:25:09.162 [2024-04-26 15:12:49.877645] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:09.162 [2024-04-26 15:12:49.896925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:09.162 [2024-04-26 15:12:49.900299] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:09.162 [2024-04-26 15:12:49.900316] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:09.162 [2024-04-26 15:12:49.900323] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:10.109 [2024-04-26 15:12:50.904924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:10.109 [2024-04-26 15:12:50.904978] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:10.109 [2024-04-26 15:12:50.905515] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:10.109 [2024-04-26 15:12:50.905524] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:10.109 [2024-04-26 15:12:50.905533] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:25:10.109 [2024-04-26 15:12:50.905965] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:10.109 [2024-04-26 15:12:50.909080] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:10.109 [2024-04-26 15:12:50.919908] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:10.109 [2024-04-26 15:12:50.923422] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:10.109 [2024-04-26 15:12:50.923440] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:10.109 [2024-04-26 15:12:50.923446] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:11.052 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3651386 Killed "${NVMF_APP[@]}" "$@" 00:25:11.052 15:12:51 -- host/bdevperf.sh@36 -- # tgt_init 00:25:11.052 15:12:51 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:25:11.052 15:12:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:11.052 15:12:51 -- common/autotest_common.sh@720 -- # xtrace_disable 00:25:11.052 15:12:51 -- common/autotest_common.sh@10 -- # set +x 00:25:11.052 15:12:51 -- nvmf/common.sh@470 -- # nvmfpid=3653089 00:25:11.052 15:12:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:11.052 15:12:51 -- nvmf/common.sh@471 -- # waitforlisten 3653089 00:25:11.052 15:12:51 -- common/autotest_common.sh@827 -- # '[' -z 3653089 ']' 00:25:11.052 15:12:51 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:11.052 15:12:51 -- common/autotest_common.sh@832 -- # local max_retries=100 00:25:11.052 15:12:51 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:11.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:11.052 15:12:51 -- common/autotest_common.sh@836 -- # xtrace_disable 00:25:11.052 15:12:51 -- common/autotest_common.sh@10 -- # set +x 00:25:11.052 [2024-04-26 15:12:51.879713] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:11.052 [2024-04-26 15:12:51.879750] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:11.052 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.052 [2024-04-26 15:12:51.927621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:11.052 [2024-04-26 15:12:51.927639] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:11.052 [2024-04-26 15:12:51.927862] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:11.052 [2024-04-26 15:12:51.927871] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:11.052 [2024-04-26 15:12:51.927879] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:25:11.052 [2024-04-26 15:12:51.930395] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:11.052 [2024-04-26 15:12:51.931428] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:11.052 [2024-04-26 15:12:51.931821] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:11.052 [2024-04-26 15:12:51.944340] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:11.052 [2024-04-26 15:12:51.947737] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:11.052 [2024-04-26 15:12:51.947755] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:11.052 [2024-04-26 15:12:51.947761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:11.052 [2024-04-26 15:12:51.993765] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:11.052 [2024-04-26 15:12:51.993799] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:11.052 [2024-04-26 15:12:51.993807] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:11.052 [2024-04-26 15:12:51.993815] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:11.052 [2024-04-26 15:12:51.993820] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:11.052 [2024-04-26 15:12:51.993925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:11.052 [2024-04-26 15:12:51.994064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:11.052 [2024-04-26 15:12:51.994066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:11.323 15:12:52 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:25:11.323 15:12:52 -- common/autotest_common.sh@860 -- # return 0 00:25:11.323 15:12:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:11.323 15:12:52 -- common/autotest_common.sh@726 -- # xtrace_disable 00:25:11.323 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.323 15:12:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:11.323 15:12:52 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:25:11.323 15:12:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:11.323 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.323 [2024-04-26 15:12:52.158721] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e3b2f0/0x1e3f7e0) succeed. 00:25:11.323 [2024-04-26 15:12:52.171647] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e3c890/0x1e80e70) succeed. 00:25:11.323 15:12:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:11.323 15:12:52 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:11.323 15:12:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:11.323 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.584 Malloc0 00:25:11.584 15:12:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:11.584 15:12:52 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:11.584 15:12:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:11.584 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.584 15:12:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:11.584 15:12:52 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:11.584 15:12:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:11.584 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.584 15:12:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:11.584 15:12:52 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:11.584 15:12:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:11.584 15:12:52 -- common/autotest_common.sh@10 -- # set +x 00:25:11.584 [2024-04-26 15:12:52.317855] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:11.584 15:12:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:11.584 15:12:52 -- host/bdevperf.sh@38 -- # wait 3651763 00:25:12.156 [2024-04-26 15:12:52.952009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:12.156 [2024-04-26 15:12:52.952029] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:12.156 [2024-04-26 15:12:52.952247] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:12.156 [2024-04-26 15:12:52.952255] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:12.156 [2024-04-26 15:12:52.952264] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:25:12.156 [2024-04-26 15:12:52.954783] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:12.156 [2024-04-26 15:12:52.955815] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:12.156 [2024-04-26 15:12:52.968735] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:12.156 [2024-04-26 15:12:53.030211] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:20.299 00:25:20.299 Latency(us) 00:25:20.299 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:20.299 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:20.299 Verification LBA range: start 0x0 length 0x4000 00:25:20.299 Nvme1n1 : 15.01 12166.27 47.52 7855.06 0.00 6368.70 353.28 1034594.99 00:25:20.299 =================================================================================================================== 00:25:20.299 Total : 12166.27 47.52 7855.06 0.00 6368.70 353.28 1034594.99 00:25:20.561 15:13:01 -- host/bdevperf.sh@39 -- # sync 00:25:20.561 15:13:01 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:20.561 15:13:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:20.561 15:13:01 -- common/autotest_common.sh@10 -- # set +x 00:25:20.561 15:13:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:20.561 15:13:01 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:25:20.561 15:13:01 -- host/bdevperf.sh@44 -- # nvmftestfini 00:25:20.561 15:13:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:20.561 15:13:01 -- nvmf/common.sh@117 -- # sync 00:25:20.561 15:13:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:20.561 15:13:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:20.561 15:13:01 -- nvmf/common.sh@120 -- # set +e 00:25:20.561 15:13:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:20.561 15:13:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:20.561 rmmod nvme_rdma 00:25:20.561 rmmod nvme_fabrics 00:25:20.561 15:13:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:20.561 15:13:01 -- nvmf/common.sh@124 -- # set -e 00:25:20.561 15:13:01 -- nvmf/common.sh@125 -- # return 0 00:25:20.561 15:13:01 -- nvmf/common.sh@478 -- # '[' -n 3653089 ']' 00:25:20.561 15:13:01 -- nvmf/common.sh@479 -- # killprocess 3653089 00:25:20.561 15:13:01 -- common/autotest_common.sh@946 -- # '[' -z 3653089 ']' 00:25:20.561 15:13:01 -- common/autotest_common.sh@950 -- # kill -0 3653089 00:25:20.561 15:13:01 -- common/autotest_common.sh@951 -- # uname 00:25:20.561 15:13:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:25:20.561 15:13:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3653089 00:25:20.561 15:13:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:25:20.561 15:13:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:25:20.561 15:13:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3653089' 00:25:20.561 killing process with pid 3653089 00:25:20.561 15:13:01 -- common/autotest_common.sh@965 -- # kill 3653089 00:25:20.561 15:13:01 -- common/autotest_common.sh@970 -- # wait 3653089 00:25:20.823 [2024-04-26 15:13:01.566234] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:20.823 15:13:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:20.823 15:13:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:20.823 00:25:20.823 real 0m25.073s 00:25:20.823 user 1m4.032s 00:25:20.823 sys 0m5.643s 00:25:20.823 15:13:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:25:20.823 15:13:01 -- common/autotest_common.sh@10 -- # set +x 00:25:20.823 ************************************ 00:25:20.823 END TEST nvmf_bdevperf 00:25:20.823 ************************************ 00:25:20.823 15:13:01 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:25:20.823 15:13:01 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:25:20.823 15:13:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:25:20.823 15:13:01 -- common/autotest_common.sh@10 -- # set +x 00:25:21.085 ************************************ 00:25:21.085 START TEST nvmf_target_disconnect 00:25:21.085 ************************************ 00:25:21.085 15:13:01 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:25:21.085 * Looking for test storage... 00:25:21.085 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:25:21.085 15:13:01 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:25:21.085 15:13:01 -- nvmf/common.sh@7 -- # uname -s 00:25:21.085 15:13:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:21.085 15:13:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:21.085 15:13:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:21.085 15:13:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:21.085 15:13:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:21.085 15:13:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:21.085 15:13:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:21.085 15:13:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:21.085 15:13:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:21.085 15:13:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:21.085 15:13:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:21.085 15:13:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:25:21.085 15:13:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:21.085 15:13:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:21.085 15:13:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:21.085 15:13:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:21.085 15:13:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:25:21.085 15:13:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:21.085 15:13:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:21.085 15:13:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:21.085 15:13:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.085 15:13:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.085 15:13:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.085 15:13:02 -- paths/export.sh@5 -- # export PATH 00:25:21.085 15:13:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.085 15:13:02 -- nvmf/common.sh@47 -- # : 0 00:25:21.085 15:13:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:21.085 15:13:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:21.085 15:13:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:21.085 15:13:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:21.085 15:13:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:21.085 15:13:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:21.085 15:13:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:21.085 15:13:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:21.085 15:13:02 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:25:21.085 15:13:02 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:25:21.085 15:13:02 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:25:21.085 15:13:02 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:25:21.085 15:13:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:21.085 15:13:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:21.085 15:13:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:21.085 15:13:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:21.085 15:13:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:21.085 15:13:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.085 15:13:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.085 15:13:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.086 15:13:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:21.086 15:13:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:21.086 15:13:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:21.086 15:13:02 -- common/autotest_common.sh@10 -- # set +x 00:25:27.679 15:13:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:27.679 15:13:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:27.679 15:13:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:27.679 15:13:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:27.679 15:13:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:27.679 15:13:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:27.679 15:13:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:27.679 15:13:08 -- nvmf/common.sh@295 -- # net_devs=() 00:25:27.679 15:13:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:27.679 15:13:08 -- nvmf/common.sh@296 -- # e810=() 00:25:27.679 15:13:08 -- nvmf/common.sh@296 -- # local -ga e810 00:25:27.679 15:13:08 -- nvmf/common.sh@297 -- # x722=() 00:25:27.679 15:13:08 -- nvmf/common.sh@297 -- # local -ga x722 00:25:27.679 15:13:08 -- nvmf/common.sh@298 -- # mlx=() 00:25:27.679 15:13:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:27.679 15:13:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:27.679 15:13:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:25:27.679 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:25:27.679 15:13:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:27.679 15:13:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:25:27.679 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:25:27.679 15:13:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:27.679 15:13:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.679 15:13:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.679 15:13:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:25:27.679 Found net devices under 0000:31:00.0: mlx_0_0 00:25:27.679 15:13:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.679 15:13:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.679 15:13:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:25:27.679 Found net devices under 0000:31:00.1: mlx_0_1 00:25:27.679 15:13:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.679 15:13:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:27.679 15:13:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:27.679 15:13:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:27.679 15:13:08 -- nvmf/common.sh@58 -- # uname 00:25:27.679 15:13:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:27.679 15:13:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:27.679 15:13:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:27.679 15:13:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:27.679 15:13:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:27.679 15:13:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:27.679 15:13:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:27.679 15:13:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:27.679 15:13:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:27.679 15:13:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:27.679 15:13:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:27.679 15:13:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:27.679 15:13:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:27.679 15:13:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:27.679 15:13:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:27.679 15:13:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:27.679 15:13:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:27.679 15:13:08 -- nvmf/common.sh@105 -- # continue 2 00:25:27.679 15:13:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.679 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:27.679 15:13:08 -- nvmf/common.sh@105 -- # continue 2 00:25:27.679 15:13:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:27.679 15:13:08 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:25:27.679 15:13:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:27.679 15:13:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:27.679 15:13:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:25:27.679 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:27.679 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:25:27.679 altname enp49s0f0np0 00:25:27.679 altname ens786f0np0 00:25:27.679 inet 192.168.100.8/24 scope global mlx_0_0 00:25:27.679 valid_lft forever preferred_lft forever 00:25:27.679 15:13:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:27.679 15:13:08 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:25:27.679 15:13:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:27.679 15:13:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:27.679 15:13:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:27.679 15:13:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:25:27.679 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:27.679 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:25:27.679 altname enp49s0f1np1 00:25:27.679 altname ens786f1np1 00:25:27.679 inet 192.168.100.9/24 scope global mlx_0_1 00:25:27.679 valid_lft forever preferred_lft forever 00:25:27.679 15:13:08 -- nvmf/common.sh@411 -- # return 0 00:25:27.679 15:13:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:27.679 15:13:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:27.679 15:13:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:27.679 15:13:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:27.679 15:13:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:27.679 15:13:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:27.680 15:13:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:27.680 15:13:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:27.680 15:13:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:27.680 15:13:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:27.680 15:13:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:27.680 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.680 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:27.680 15:13:08 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:27.680 15:13:08 -- nvmf/common.sh@105 -- # continue 2 00:25:27.680 15:13:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:27.680 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.680 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:27.680 15:13:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:27.680 15:13:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:27.680 15:13:08 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:27.680 15:13:08 -- nvmf/common.sh@105 -- # continue 2 00:25:27.680 15:13:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:27.680 15:13:08 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:25:27.680 15:13:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:27.680 15:13:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:27.680 15:13:08 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:25:27.680 15:13:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:27.680 15:13:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:27.680 15:13:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:27.680 192.168.100.9' 00:25:27.680 15:13:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:27.680 192.168.100.9' 00:25:27.680 15:13:08 -- nvmf/common.sh@446 -- # head -n 1 00:25:27.680 15:13:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:27.680 15:13:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:27.680 192.168.100.9' 00:25:27.680 15:13:08 -- nvmf/common.sh@447 -- # tail -n +2 00:25:27.680 15:13:08 -- nvmf/common.sh@447 -- # head -n 1 00:25:27.680 15:13:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:27.680 15:13:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:27.680 15:13:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:27.680 15:13:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:27.680 15:13:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:27.680 15:13:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:27.680 15:13:08 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:25:27.680 15:13:08 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:25:27.680 15:13:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:25:27.680 15:13:08 -- common/autotest_common.sh@10 -- # set +x 00:25:27.941 ************************************ 00:25:27.941 START TEST nvmf_target_disconnect_tc1 00:25:27.941 ************************************ 00:25:27.941 15:13:08 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc1 00:25:27.941 15:13:08 -- host/target_disconnect.sh@32 -- # set +e 00:25:27.941 15:13:08 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:25:27.941 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.941 [2024-04-26 15:13:08.805667] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:27.941 [2024-04-26 15:13:08.805704] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:27.941 [2024-04-26 15:13:08.805712] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:25:28.884 [2024-04-26 15:13:09.809843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:28.884 [2024-04-26 15:13:09.809899] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:25:28.884 [2024-04-26 15:13:09.809923] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:25:28.884 [2024-04-26 15:13:09.809975] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:28.884 [2024-04-26 15:13:09.809996] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:25:28.884 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:25:28.884 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:25:28.884 Initializing NVMe Controllers 00:25:28.884 15:13:09 -- host/target_disconnect.sh@33 -- # trap - ERR 00:25:28.884 15:13:09 -- host/target_disconnect.sh@33 -- # print_backtrace 00:25:28.884 15:13:09 -- common/autotest_common.sh@1149 -- # [[ hxBET =~ e ]] 00:25:28.884 15:13:09 -- common/autotest_common.sh@1149 -- # return 0 00:25:28.884 15:13:09 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:25:28.884 15:13:09 -- host/target_disconnect.sh@41 -- # set -e 00:25:28.884 00:25:28.884 real 0m1.104s 00:25:28.884 user 0m0.949s 00:25:28.884 sys 0m0.138s 00:25:28.884 15:13:09 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:25:28.884 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:25:28.884 ************************************ 00:25:28.884 END TEST nvmf_target_disconnect_tc1 00:25:28.884 ************************************ 00:25:29.145 15:13:09 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:25:29.145 15:13:09 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:25:29.145 15:13:09 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:25:29.145 15:13:09 -- common/autotest_common.sh@10 -- # set +x 00:25:29.145 ************************************ 00:25:29.145 START TEST nvmf_target_disconnect_tc2 00:25:29.145 ************************************ 00:25:29.145 15:13:10 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc2 00:25:29.145 15:13:10 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:25:29.145 15:13:10 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:25:29.145 15:13:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:29.145 15:13:10 -- common/autotest_common.sh@720 -- # xtrace_disable 00:25:29.145 15:13:10 -- common/autotest_common.sh@10 -- # set +x 00:25:29.145 15:13:10 -- nvmf/common.sh@470 -- # nvmfpid=3658812 00:25:29.145 15:13:10 -- nvmf/common.sh@471 -- # waitforlisten 3658812 00:25:29.145 15:13:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:25:29.145 15:13:10 -- common/autotest_common.sh@827 -- # '[' -z 3658812 ']' 00:25:29.145 15:13:10 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:29.145 15:13:10 -- common/autotest_common.sh@832 -- # local max_retries=100 00:25:29.145 15:13:10 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:29.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:29.145 15:13:10 -- common/autotest_common.sh@836 -- # xtrace_disable 00:25:29.145 15:13:10 -- common/autotest_common.sh@10 -- # set +x 00:25:29.145 [2024-04-26 15:13:10.061663] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:29.145 [2024-04-26 15:13:10.061729] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:29.145 EAL: No free 2048 kB hugepages reported on node 1 00:25:29.407 [2024-04-26 15:13:10.143637] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:29.407 [2024-04-26 15:13:10.236977] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:29.407 [2024-04-26 15:13:10.237026] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:29.407 [2024-04-26 15:13:10.237035] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:29.407 [2024-04-26 15:13:10.237042] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:29.407 [2024-04-26 15:13:10.237048] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:29.407 [2024-04-26 15:13:10.237210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:25:29.407 [2024-04-26 15:13:10.237348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:25:29.407 [2024-04-26 15:13:10.237485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:29.407 [2024-04-26 15:13:10.237486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:25:29.980 15:13:10 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:25:29.980 15:13:10 -- common/autotest_common.sh@860 -- # return 0 00:25:29.980 15:13:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:29.980 15:13:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:25:29.980 15:13:10 -- common/autotest_common.sh@10 -- # set +x 00:25:29.980 15:13:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:29.980 15:13:10 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:29.980 15:13:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:29.980 15:13:10 -- common/autotest_common.sh@10 -- # set +x 00:25:29.980 Malloc0 00:25:29.980 15:13:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:29.980 15:13:10 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:25:29.980 15:13:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:29.980 15:13:10 -- common/autotest_common.sh@10 -- # set +x 00:25:30.241 [2024-04-26 15:13:10.959004] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2296dc0/0x22a2a40) succeed. 00:25:30.241 [2024-04-26 15:13:10.974733] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2298400/0x2342b40) succeed. 00:25:30.241 15:13:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:30.241 15:13:11 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:30.241 15:13:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:30.241 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:25:30.241 15:13:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:30.241 15:13:11 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:30.241 15:13:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:30.241 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:25:30.241 15:13:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:30.241 15:13:11 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:30.241 15:13:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:30.241 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:25:30.241 [2024-04-26 15:13:11.133834] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:30.241 15:13:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:30.241 15:13:11 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:25:30.241 15:13:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:30.241 15:13:11 -- common/autotest_common.sh@10 -- # set +x 00:25:30.241 15:13:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:30.241 15:13:11 -- host/target_disconnect.sh@50 -- # reconnectpid=3659161 00:25:30.241 15:13:11 -- host/target_disconnect.sh@52 -- # sleep 2 00:25:30.241 15:13:11 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:25:30.503 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.420 15:13:13 -- host/target_disconnect.sh@53 -- # kill -9 3658812 00:25:32.420 15:13:13 -- host/target_disconnect.sh@55 -- # sleep 2 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Write completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.806 Read completed with error (sct=0, sc=8) 00:25:33.806 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Write completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 Read completed with error (sct=0, sc=8) 00:25:33.807 starting I/O failed 00:25:33.807 [2024-04-26 15:13:14.339242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:33.807 [2024-04-26 15:13:14.341603] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:33.807 [2024-04-26 15:13:14.341616] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:33.807 [2024-04-26 15:13:14.341620] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:34.381 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3658812 Killed "${NVMF_APP[@]}" "$@" 00:25:34.381 15:13:15 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:25:34.381 15:13:15 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:25:34.381 15:13:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:34.381 15:13:15 -- common/autotest_common.sh@720 -- # xtrace_disable 00:25:34.381 15:13:15 -- common/autotest_common.sh@10 -- # set +x 00:25:34.381 15:13:15 -- nvmf/common.sh@470 -- # nvmfpid=3659846 00:25:34.381 15:13:15 -- nvmf/common.sh@471 -- # waitforlisten 3659846 00:25:34.381 15:13:15 -- common/autotest_common.sh@827 -- # '[' -z 3659846 ']' 00:25:34.381 15:13:15 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:34.381 15:13:15 -- common/autotest_common.sh@832 -- # local max_retries=100 00:25:34.381 15:13:15 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:34.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:34.381 15:13:15 -- common/autotest_common.sh@836 -- # xtrace_disable 00:25:34.381 15:13:15 -- common/autotest_common.sh@10 -- # set +x 00:25:34.381 15:13:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:25:34.381 [2024-04-26 15:13:15.203964] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:34.381 [2024-04-26 15:13:15.204009] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:34.381 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.381 [2024-04-26 15:13:15.252564] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:34.381 [2024-04-26 15:13:15.307087] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.381 [2024-04-26 15:13:15.307118] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.381 [2024-04-26 15:13:15.307123] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:34.381 [2024-04-26 15:13:15.307127] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:34.381 [2024-04-26 15:13:15.307132] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.381 [2024-04-26 15:13:15.307272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:25:34.381 [2024-04-26 15:13:15.307441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:25:34.381 [2024-04-26 15:13:15.307666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:34.381 [2024-04-26 15:13:15.307667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:25:34.642 [2024-04-26 15:13:15.345728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:34.642 qpair failed and we were unable to recover it. 00:25:34.642 [2024-04-26 15:13:15.348161] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:34.642 [2024-04-26 15:13:15.348172] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:34.642 [2024-04-26 15:13:15.348176] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.214 15:13:15 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:25:35.214 15:13:15 -- common/autotest_common.sh@860 -- # return 0 00:25:35.214 15:13:15 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:35.214 15:13:15 -- common/autotest_common.sh@726 -- # xtrace_disable 00:25:35.214 15:13:15 -- common/autotest_common.sh@10 -- # set +x 00:25:35.214 15:13:15 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:35.214 15:13:15 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:35.214 15:13:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.214 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.214 Malloc0 00:25:35.214 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.214 15:13:16 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:25:35.214 15:13:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.214 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.214 [2024-04-26 15:13:16.049296] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d0edc0/0x1d1aa40) succeed. 00:25:35.214 [2024-04-26 15:13:16.061554] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d10400/0x1dbab40) succeed. 00:25:35.214 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.214 15:13:16 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:35.214 15:13:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.214 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.475 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.475 15:13:16 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:35.475 15:13:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.475 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.475 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.475 15:13:16 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:25:35.475 15:13:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.475 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.475 [2024-04-26 15:13:16.179984] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:25:35.475 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.475 15:13:16 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:25:35.475 15:13:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:35.475 15:13:16 -- common/autotest_common.sh@10 -- # set +x 00:25:35.475 15:13:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:35.475 15:13:16 -- host/target_disconnect.sh@58 -- # wait 3659161 00:25:35.475 [2024-04-26 15:13:16.352564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.475 qpair failed and we were unable to recover it. 00:25:35.475 [2024-04-26 15:13:16.363485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.475 [2024-04-26 15:13:16.363525] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.475 [2024-04-26 15:13:16.363538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.475 [2024-04-26 15:13:16.363544] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.475 [2024-04-26 15:13:16.363548] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.475 [2024-04-26 15:13:16.371969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.475 qpair failed and we were unable to recover it. 00:25:35.475 [2024-04-26 15:13:16.383433] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.475 [2024-04-26 15:13:16.383466] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.475 [2024-04-26 15:13:16.383477] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.475 [2024-04-26 15:13:16.383482] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.475 [2024-04-26 15:13:16.383490] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.475 [2024-04-26 15:13:16.392177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.475 qpair failed and we were unable to recover it. 00:25:35.475 [2024-04-26 15:13:16.403352] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.475 [2024-04-26 15:13:16.403382] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.475 [2024-04-26 15:13:16.403392] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.475 [2024-04-26 15:13:16.403397] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.475 [2024-04-26 15:13:16.403401] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.475 [2024-04-26 15:13:16.412207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.475 qpair failed and we were unable to recover it. 00:25:35.475 [2024-04-26 15:13:16.423160] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.475 [2024-04-26 15:13:16.423190] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.475 [2024-04-26 15:13:16.423200] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.475 [2024-04-26 15:13:16.423205] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.475 [2024-04-26 15:13:16.423210] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.432306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.443427] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.443461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.443472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.443476] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.443481] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.452211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.463609] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.463635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.463645] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.463650] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.463654] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.472358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.483241] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.483270] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.483285] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.483290] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.483295] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.492523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.503330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.503360] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.503370] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.503375] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.503379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.512150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.523402] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.523431] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.523441] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.523446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.523450] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.532614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.543926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.543960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.543980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.543986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.543991] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.552453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.563981] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.564015] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.564026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.564034] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.564039] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.572641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.583456] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.583482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.583491] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.583496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.583500] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.592581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.604039] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.604074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.737 [2024-04-26 15:13:16.604084] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.737 [2024-04-26 15:13:16.604089] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.737 [2024-04-26 15:13:16.604093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.737 [2024-04-26 15:13:16.612599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.737 qpair failed and we were unable to recover it. 00:25:35.737 [2024-04-26 15:13:16.624153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.737 [2024-04-26 15:13:16.624178] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.738 [2024-04-26 15:13:16.624188] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.738 [2024-04-26 15:13:16.624193] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.738 [2024-04-26 15:13:16.624197] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.738 [2024-04-26 15:13:16.632885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.738 qpair failed and we were unable to recover it. 00:25:35.738 [2024-04-26 15:13:16.644366] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.738 [2024-04-26 15:13:16.644404] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.738 [2024-04-26 15:13:16.644424] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.738 [2024-04-26 15:13:16.644430] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.738 [2024-04-26 15:13:16.644434] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.738 [2024-04-26 15:13:16.652677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.738 qpair failed and we were unable to recover it. 00:25:35.738 [2024-04-26 15:13:16.663708] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.738 [2024-04-26 15:13:16.663736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.738 [2024-04-26 15:13:16.663746] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.738 [2024-04-26 15:13:16.663751] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.738 [2024-04-26 15:13:16.663756] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.738 [2024-04-26 15:13:16.672682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.738 qpair failed and we were unable to recover it. 00:25:35.738 [2024-04-26 15:13:16.683891] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.738 [2024-04-26 15:13:16.683922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.738 [2024-04-26 15:13:16.683932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.738 [2024-04-26 15:13:16.683937] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.738 [2024-04-26 15:13:16.683941] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.692680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.704198] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.704225] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.704235] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.704240] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.704244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.712967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.724388] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.724423] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.724443] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.724449] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.724453] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.732931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.744014] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.744044] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.744059] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.744064] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.744069] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.753011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.763924] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.763958] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.763968] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.763972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.763977] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.772985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.784516] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.784546] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.784565] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.784571] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.784576] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.793456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.804735] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.804764] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.804784] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.804790] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.804795] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.813445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.824194] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:35.999 [2024-04-26 15:13:16.824222] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:35.999 [2024-04-26 15:13:16.824232] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:35.999 [2024-04-26 15:13:16.824237] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:35.999 [2024-04-26 15:13:16.824244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:35.999 [2024-04-26 15:13:16.833323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:35.999 qpair failed and we were unable to recover it. 00:25:35.999 [2024-04-26 15:13:16.844312] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.844345] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.844355] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.844359] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.844364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.000 [2024-04-26 15:13:16.853453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.000 qpair failed and we were unable to recover it. 00:25:36.000 [2024-04-26 15:13:16.864981] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.865005] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.865015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.865020] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.865024] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.000 [2024-04-26 15:13:16.873425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.000 qpair failed and we were unable to recover it. 00:25:36.000 [2024-04-26 15:13:16.884984] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.885009] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.885018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.885023] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.885027] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.000 [2024-04-26 15:13:16.893434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.000 qpair failed and we were unable to recover it. 00:25:36.000 [2024-04-26 15:13:16.904446] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.904473] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.904482] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.904488] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.904493] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.000 [2024-04-26 15:13:16.913418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.000 qpair failed and we were unable to recover it. 00:25:36.000 [2024-04-26 15:13:16.924747] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.924777] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.924796] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.924802] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.924807] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.000 [2024-04-26 15:13:16.933603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.000 qpair failed and we were unable to recover it. 00:25:36.000 [2024-04-26 15:13:16.945184] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.000 [2024-04-26 15:13:16.945216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.000 [2024-04-26 15:13:16.945235] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.000 [2024-04-26 15:13:16.945241] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.000 [2024-04-26 15:13:16.945246] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:16.953574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:16.965068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:16.965098] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:16.965117] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:16.965123] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:16.965128] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:16.973594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:16.984643] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:16.984672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:16.984682] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:16.984687] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:16.984692] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:16.993629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.004629] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.004659] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.004668] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.004676] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.004681] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.013827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.025228] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.025252] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.025261] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.025266] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.025270] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.033701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.045638] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.045670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.045690] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.045696] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.045700] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.053903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.064652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.064679] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.064690] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.064694] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.064699] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.073694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.085031] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.085060] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.085069] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.085074] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.085078] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.093878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.105372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.105402] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.105411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.105416] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.105420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.114154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.125389] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.125420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.125429] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.125434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.125438] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.133924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.145246] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.145274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.145299] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.145305] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.145309] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.153983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.165307] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.165341] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.165360] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.165366] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.165371] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.174086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.185738] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.262 [2024-04-26 15:13:17.185772] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.262 [2024-04-26 15:13:17.185794] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.262 [2024-04-26 15:13:17.185800] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.262 [2024-04-26 15:13:17.185805] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.262 [2024-04-26 15:13:17.194437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.262 qpair failed and we were unable to recover it. 00:25:36.262 [2024-04-26 15:13:17.206002] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.263 [2024-04-26 15:13:17.206035] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.263 [2024-04-26 15:13:17.206046] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.263 [2024-04-26 15:13:17.206051] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.263 [2024-04-26 15:13:17.206056] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.214271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.225445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.225472] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.225482] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.225487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.225492] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.234225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.245346] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.245376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.245385] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.245390] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.245394] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.254525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.266288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.266320] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.266340] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.266345] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.266353] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.274649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.285943] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.285974] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.285985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.285990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.285994] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.294615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.305552] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.305581] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.305591] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.305596] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.305600] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.314683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.325926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.325960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.325969] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.325974] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.325978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.334839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.346521] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.524 [2024-04-26 15:13:17.346555] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.524 [2024-04-26 15:13:17.346575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.524 [2024-04-26 15:13:17.346581] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.524 [2024-04-26 15:13:17.346586] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.524 [2024-04-26 15:13:17.354992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.524 qpair failed and we were unable to recover it. 00:25:36.524 [2024-04-26 15:13:17.366117] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.366151] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.366161] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.366166] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.366171] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.525 [2024-04-26 15:13:17.375003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.525 qpair failed and we were unable to recover it. 00:25:36.525 [2024-04-26 15:13:17.385904] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.385931] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.385940] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.385945] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.385950] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.525 [2024-04-26 15:13:17.394769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.525 qpair failed and we were unable to recover it. 00:25:36.525 [2024-04-26 15:13:17.405802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.405833] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.405842] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.405847] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.405852] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.525 [2024-04-26 15:13:17.414745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.525 qpair failed and we were unable to recover it. 00:25:36.525 [2024-04-26 15:13:17.426500] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.426528] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.426537] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.426542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.426546] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.525 [2024-04-26 15:13:17.434891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.525 qpair failed and we were unable to recover it. 00:25:36.525 [2024-04-26 15:13:17.446511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.446538] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.446548] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.446555] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.446560] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.525 [2024-04-26 15:13:17.454840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.525 qpair failed and we were unable to recover it. 00:25:36.525 [2024-04-26 15:13:17.465990] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.525 [2024-04-26 15:13:17.466018] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.525 [2024-04-26 15:13:17.466027] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.525 [2024-04-26 15:13:17.466032] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.525 [2024-04-26 15:13:17.466036] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.475065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.786 qpair failed and we were unable to recover it. 00:25:36.786 [2024-04-26 15:13:17.486106] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.786 [2024-04-26 15:13:17.486138] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.786 [2024-04-26 15:13:17.486158] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.786 [2024-04-26 15:13:17.486163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.786 [2024-04-26 15:13:17.486168] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.495128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.786 qpair failed and we were unable to recover it. 00:25:36.786 [2024-04-26 15:13:17.506532] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.786 [2024-04-26 15:13:17.506560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.786 [2024-04-26 15:13:17.506570] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.786 [2024-04-26 15:13:17.506575] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.786 [2024-04-26 15:13:17.506580] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.515429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.786 qpair failed and we were unable to recover it. 00:25:36.786 [2024-04-26 15:13:17.526707] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.786 [2024-04-26 15:13:17.526739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.786 [2024-04-26 15:13:17.526749] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.786 [2024-04-26 15:13:17.526754] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.786 [2024-04-26 15:13:17.526758] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.535456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.786 qpair failed and we were unable to recover it. 00:25:36.786 [2024-04-26 15:13:17.546213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.786 [2024-04-26 15:13:17.546241] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.786 [2024-04-26 15:13:17.546251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.786 [2024-04-26 15:13:17.546256] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.786 [2024-04-26 15:13:17.546260] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.555431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.786 qpair failed and we were unable to recover it. 00:25:36.786 [2024-04-26 15:13:17.566554] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.786 [2024-04-26 15:13:17.566586] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.786 [2024-04-26 15:13:17.566605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.786 [2024-04-26 15:13:17.566611] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.786 [2024-04-26 15:13:17.566616] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.786 [2024-04-26 15:13:17.575324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.587026] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.587053] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.587063] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.587068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.587073] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.595225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.606908] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.606932] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.606942] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.606947] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.606951] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.615477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.626419] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.626444] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.626456] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.626461] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.626466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.635465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.646884] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.646916] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.646925] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.646930] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.646935] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.655643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.666820] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.666849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.666859] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.666863] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.666868] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.675672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.687286] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.687324] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.687344] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.687350] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.687355] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.695585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.706695] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.706720] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.706731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.706736] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.706743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:36.787 [2024-04-26 15:13:17.715580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:36.787 qpair failed and we were unable to recover it. 00:25:36.787 [2024-04-26 15:13:17.727136] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:36.787 [2024-04-26 15:13:17.727166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:36.787 [2024-04-26 15:13:17.727177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:36.787 [2024-04-26 15:13:17.727182] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:36.787 [2024-04-26 15:13:17.727186] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.048 [2024-04-26 15:13:17.735849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.048 qpair failed and we were unable to recover it. 00:25:37.048 [2024-04-26 15:13:17.747228] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.048 [2024-04-26 15:13:17.747254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.048 [2024-04-26 15:13:17.747264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.747269] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.747273] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.755917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.767220] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.767246] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.767256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.767260] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.767265] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.775908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.787045] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.787074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.787083] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.787088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.787092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.795821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.807270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.807306] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.807315] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.807320] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.807325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.816037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.827243] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.827270] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.827282] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.827287] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.827291] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.835922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.847511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.847539] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.847549] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.847553] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.847558] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.856047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.866978] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.867006] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.867015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.867020] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.867024] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.876056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.887613] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.887641] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.887650] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.887658] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.887662] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.896342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.907502] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.907532] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.907542] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.907547] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.907551] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.916364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.928053] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.928085] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.928105] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.928110] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.928115] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.936426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.947438] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.947466] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.947477] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.947482] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.947486] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.956261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.968081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.968112] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.968132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.968138] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.968143] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.976560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.049 [2024-04-26 15:13:17.987808] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.049 [2024-04-26 15:13:17.987838] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.049 [2024-04-26 15:13:17.987849] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.049 [2024-04-26 15:13:17.987854] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.049 [2024-04-26 15:13:17.987858] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.049 [2024-04-26 15:13:17.996327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.049 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.008011] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.008036] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.008046] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.008051] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.008055] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.016447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.027485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.027511] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.027520] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.027525] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.027529] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.036528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.047948] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.047980] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.047999] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.048005] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.048010] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.056755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.067996] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.068022] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.068039] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.068044] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.068048] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.076683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.088423] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.088455] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.088475] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.088481] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.088485] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.096807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.107804] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.107831] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.107841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.107846] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.107851] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.116787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.128137] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.128167] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.128177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.128182] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.128186] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.136770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.147991] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.148018] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.148027] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.148032] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.148040] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.156765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.168393] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.168420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.168430] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.168435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.168439] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.177039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.188131] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.188156] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.188165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.188170] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.188174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.196944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.208374] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.208410] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.208419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.208424] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.208428] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.217006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.228562] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.228590] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.311 [2024-04-26 15:13:18.228599] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.311 [2024-04-26 15:13:18.228604] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.311 [2024-04-26 15:13:18.228608] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.311 [2024-04-26 15:13:18.237307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.311 qpair failed and we were unable to recover it. 00:25:37.311 [2024-04-26 15:13:18.248642] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.311 [2024-04-26 15:13:18.248670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.312 [2024-04-26 15:13:18.248679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.312 [2024-04-26 15:13:18.248684] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.312 [2024-04-26 15:13:18.248688] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.312 [2024-04-26 15:13:18.257037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.312 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.268268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.268300] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.268310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.268315] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.268319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.277297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.288831] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.288861] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.288870] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.288875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.288879] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.297439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.308939] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.308966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.308975] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.308980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.308984] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.317665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.328839] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.328870] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.328879] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.328886] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.328891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.337300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.348500] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.348528] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.348538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.348542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.348546] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.357301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.369023] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.369053] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.369062] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.369067] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.369071] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.377588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.388978] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.389004] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.389013] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.389018] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.389022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.398033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.409094] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.409122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.409132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.409136] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.409141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.417494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.428821] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.428848] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.428858] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.428862] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.428866] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.437682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.449081] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.449113] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.449122] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.449127] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.449131] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.457867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.469229] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.469256] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.469265] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.469270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.469274] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.477964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.573 qpair failed and we were unable to recover it. 00:25:37.573 [2024-04-26 15:13:18.489517] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.573 [2024-04-26 15:13:18.489547] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.573 [2024-04-26 15:13:18.489557] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.573 [2024-04-26 15:13:18.489561] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.573 [2024-04-26 15:13:18.489566] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.573 [2024-04-26 15:13:18.497949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.574 qpair failed and we were unable to recover it. 00:25:37.574 [2024-04-26 15:13:18.509062] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.574 [2024-04-26 15:13:18.509089] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.574 [2024-04-26 15:13:18.509100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.574 [2024-04-26 15:13:18.509105] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.574 [2024-04-26 15:13:18.509109] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.574 [2024-04-26 15:13:18.517939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.574 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.529223] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.529256] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.529265] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.529269] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.529274] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.537893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.549702] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.549729] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.549738] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.549742] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.549746] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.558210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.569622] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.569656] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.569665] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.569669] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.569673] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.578155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.589125] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.589153] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.589162] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.589167] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.589174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.598050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.609840] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.609868] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.609878] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.609882] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.609887] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.618047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.629337] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.629363] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.629372] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.629377] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.629381] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.638325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.649494] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.835 [2024-04-26 15:13:18.649526] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.835 [2024-04-26 15:13:18.649535] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.835 [2024-04-26 15:13:18.649539] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.835 [2024-04-26 15:13:18.649544] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.835 [2024-04-26 15:13:18.658230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.835 qpair failed and we were unable to recover it. 00:25:37.835 [2024-04-26 15:13:18.669405] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.669430] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.669439] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.669444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.669448] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.678460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:37.836 [2024-04-26 15:13:18.689624] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.689651] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.689660] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.689664] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.689669] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.698626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:37.836 [2024-04-26 15:13:18.709953] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.709986] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.709996] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.710001] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.710005] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.718564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:37.836 [2024-04-26 15:13:18.729967] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.729995] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.730015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.730020] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.730025] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.738855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:37.836 [2024-04-26 15:13:18.749445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.749472] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.749483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.749488] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.749492] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.758499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:37.836 [2024-04-26 15:13:18.769983] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:37.836 [2024-04-26 15:13:18.770019] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:37.836 [2024-04-26 15:13:18.770032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:37.836 [2024-04-26 15:13:18.770036] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:37.836 [2024-04-26 15:13:18.770041] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:37.836 [2024-04-26 15:13:18.778860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:37.836 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.790083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.790118] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.790127] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.790132] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.790136] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.798874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.810040] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.810064] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.810073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.810078] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.810082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.818752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.829559] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.829584] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.829593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.829598] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.829602] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.838901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.850083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.850115] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.850124] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.850130] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.850134] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.858891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.870387] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.870420] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.870430] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.870434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.870439] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.878864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.890335] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.890371] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.890380] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.097 [2024-04-26 15:13:18.890385] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.097 [2024-04-26 15:13:18.890389] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.097 [2024-04-26 15:13:18.899021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.097 qpair failed and we were unable to recover it. 00:25:38.097 [2024-04-26 15:13:18.909948] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.097 [2024-04-26 15:13:18.909976] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.097 [2024-04-26 15:13:18.909985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:18.909990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:18.909994] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:18.918938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:18.930159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:18.930192] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:18.930200] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:18.930205] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:18.930209] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:18.939017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:18.950433] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:18.950458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:18.950470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:18.950475] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:18.950479] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:18.959089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:18.970446] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:18.970471] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:18.970480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:18.970485] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:18.970489] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:18.979217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:18.990268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:18.990300] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:18.990310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:18.990314] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:18.990319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:18.999358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:19.010987] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:19.011021] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:19.011030] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:19.011035] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:19.011039] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:19.019125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.098 [2024-04-26 15:13:19.030759] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.098 [2024-04-26 15:13:19.030790] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.098 [2024-04-26 15:13:19.030799] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.098 [2024-04-26 15:13:19.030804] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.098 [2024-04-26 15:13:19.030810] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.098 [2024-04-26 15:13:19.039437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.098 qpair failed and we were unable to recover it. 00:25:38.359 [2024-04-26 15:13:19.050866] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.359 [2024-04-26 15:13:19.050900] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.359 [2024-04-26 15:13:19.050909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.359 [2024-04-26 15:13:19.050914] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.359 [2024-04-26 15:13:19.050918] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.359 [2024-04-26 15:13:19.059524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.359 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.070609] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.070636] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.070646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.070651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.070656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.079458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.091057] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.091090] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.091099] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.091104] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.091108] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.099707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.111158] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.111183] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.111193] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.111197] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.111201] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.119642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.130988] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.131019] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.131028] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.131033] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.131037] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.139866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.150822] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.150848] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.150858] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.150862] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.150866] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.159585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.170990] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.171028] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.171038] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.171042] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.171046] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.179762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.191305] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.191332] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.191341] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.191346] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.191350] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.199863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.211414] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.211439] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.211451] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.211456] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.211460] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.220054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.230991] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.231018] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.231027] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.231031] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.231036] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.239949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.251312] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.251349] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.251358] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.251363] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.251367] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.260131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.271329] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.271358] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.271368] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.271372] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.271377] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.280068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.360 [2024-04-26 15:13:19.291555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.360 [2024-04-26 15:13:19.291583] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.360 [2024-04-26 15:13:19.291592] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.360 [2024-04-26 15:13:19.291597] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.360 [2024-04-26 15:13:19.291601] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.360 [2024-04-26 15:13:19.300045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.360 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.311373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.311401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.311411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.311415] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.311420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.320272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.331907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.331944] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.331953] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.331958] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.331962] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.340319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.351878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.351908] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.351918] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.351923] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.351927] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.360327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.371881] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.371911] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.371920] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.371925] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.371929] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.380619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.391355] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.391383] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.391398] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.391403] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.391407] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.400332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.411865] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.411896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.411905] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.411910] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.411914] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.420348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.431934] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.431966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.431976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.431980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.431984] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.440582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.452010] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.452038] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.452047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.452052] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.452056] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.460485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.471582] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.471609] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.471618] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.471622] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.471629] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.480635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.491673] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.491703] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.491713] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.491717] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.491722] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.500774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.512083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.512111] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.512120] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.512125] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.512129] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.520629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.532120] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.623 [2024-04-26 15:13:19.532145] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.623 [2024-04-26 15:13:19.532154] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.623 [2024-04-26 15:13:19.532159] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.623 [2024-04-26 15:13:19.532163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.623 [2024-04-26 15:13:19.540960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.623 qpair failed and we were unable to recover it. 00:25:38.623 [2024-04-26 15:13:19.551933] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.624 [2024-04-26 15:13:19.551960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.624 [2024-04-26 15:13:19.551969] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.624 [2024-04-26 15:13:19.551974] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.624 [2024-04-26 15:13:19.551978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.624 [2024-04-26 15:13:19.560932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.624 qpair failed and we were unable to recover it. 00:25:38.889 [2024-04-26 15:13:19.572342] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.889 [2024-04-26 15:13:19.572372] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.889 [2024-04-26 15:13:19.572382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.889 [2024-04-26 15:13:19.572386] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.889 [2024-04-26 15:13:19.572390] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.889 [2024-04-26 15:13:19.581067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.889 qpair failed and we were unable to recover it. 00:25:38.889 [2024-04-26 15:13:19.592538] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.889 [2024-04-26 15:13:19.592566] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.889 [2024-04-26 15:13:19.592576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.889 [2024-04-26 15:13:19.592580] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.889 [2024-04-26 15:13:19.592584] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.889 [2024-04-26 15:13:19.601112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.889 qpair failed and we were unable to recover it. 00:25:38.889 [2024-04-26 15:13:19.612259] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.889 [2024-04-26 15:13:19.612292] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.889 [2024-04-26 15:13:19.612302] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.612307] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.612311] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.621199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.632022] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.632049] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.632059] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.632063] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.632067] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.641073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.652364] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.652396] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.652408] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.652412] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.652417] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.660962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.672513] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.672538] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.672547] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.672552] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.672556] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.681262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.692510] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.692540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.692550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.692555] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.692559] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.701283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.712344] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.712373] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.712383] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.712387] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.712391] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.721273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.732832] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.732861] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.732870] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.732875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.732879] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.741330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.752936] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.752965] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.752974] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.752979] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.752983] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.761532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.772974] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.773011] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.773020] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.773025] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.773029] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.781467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.792344] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.792371] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.792380] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.792385] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.792389] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.801561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.812537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.812562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.812571] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.812576] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.812580] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:38.890 [2024-04-26 15:13:19.821522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:38.890 qpair failed and we were unable to recover it. 00:25:38.890 [2024-04-26 15:13:19.832968] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:38.890 [2024-04-26 15:13:19.833000] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:38.890 [2024-04-26 15:13:19.833012] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:38.890 [2024-04-26 15:13:19.833017] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:38.890 [2024-04-26 15:13:19.833021] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.189 [2024-04-26 15:13:19.841723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.189 qpair failed and we were unable to recover it. 00:25:39.189 [2024-04-26 15:13:19.853289] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.189 [2024-04-26 15:13:19.853318] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.189 [2024-04-26 15:13:19.853327] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.189 [2024-04-26 15:13:19.853332] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.189 [2024-04-26 15:13:19.853336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.189 [2024-04-26 15:13:19.861868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.189 qpair failed and we were unable to recover it. 00:25:39.189 [2024-04-26 15:13:19.872901] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.189 [2024-04-26 15:13:19.872926] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.189 [2024-04-26 15:13:19.872935] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.189 [2024-04-26 15:13:19.872940] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.189 [2024-04-26 15:13:19.872944] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.189 [2024-04-26 15:13:19.881607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.189 qpair failed and we were unable to recover it. 00:25:39.189 [2024-04-26 15:13:19.893168] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.189 [2024-04-26 15:13:19.893204] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.189 [2024-04-26 15:13:19.893213] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.189 [2024-04-26 15:13:19.893218] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.893222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:19.901683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:19.913686] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:19.913711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:19.913721] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:19.913725] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.913732] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:19.921928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:19.933294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:19.933323] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:19.933332] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:19.933337] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.933341] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:19.941826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:19.953015] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:19.953041] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:19.953049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:19.953054] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.953058] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:19.961977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:19.973381] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:19.973411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:19.973420] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:19.973425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.973429] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:19.982172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:19.993579] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:19.993612] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:19.993621] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:19.993626] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:19.993630] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.002526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.012563] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.012595] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.012605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.012610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.012614] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.021579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.032063] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.032094] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.032104] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.032109] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.032113] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.042044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.053885] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.053913] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.053922] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.053927] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.053931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.062364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.073800] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.073826] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.073836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.073840] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.073845] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.082175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.093427] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.093458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.093469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.093474] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.093478] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.102667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.190 [2024-04-26 15:13:20.113170] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.190 [2024-04-26 15:13:20.113199] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.190 [2024-04-26 15:13:20.113208] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.190 [2024-04-26 15:13:20.113213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.190 [2024-04-26 15:13:20.113217] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.190 [2024-04-26 15:13:20.122293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.190 qpair failed and we were unable to recover it. 00:25:39.454 [2024-04-26 15:13:20.133526] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.454 [2024-04-26 15:13:20.133553] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.454 [2024-04-26 15:13:20.133563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.454 [2024-04-26 15:13:20.133568] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.454 [2024-04-26 15:13:20.133572] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.454 [2024-04-26 15:13:20.142333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.454 qpair failed and we were unable to recover it. 00:25:39.454 [2024-04-26 15:13:20.153797] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.454 [2024-04-26 15:13:20.153824] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.454 [2024-04-26 15:13:20.153833] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.454 [2024-04-26 15:13:20.153838] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.454 [2024-04-26 15:13:20.153842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.454 [2024-04-26 15:13:20.162337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.454 qpair failed and we were unable to recover it. 00:25:39.454 [2024-04-26 15:13:20.174004] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.454 [2024-04-26 15:13:20.174028] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.454 [2024-04-26 15:13:20.174037] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.454 [2024-04-26 15:13:20.174042] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.454 [2024-04-26 15:13:20.174046] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.454 [2024-04-26 15:13:20.182553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.454 qpair failed and we were unable to recover it. 00:25:39.454 [2024-04-26 15:13:20.193409] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.454 [2024-04-26 15:13:20.193437] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.454 [2024-04-26 15:13:20.193446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.454 [2024-04-26 15:13:20.193451] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.454 [2024-04-26 15:13:20.193455] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.454 [2024-04-26 15:13:20.202531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.214282] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.214316] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.214327] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.214332] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.214336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.222729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.234208] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.234235] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.234245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.234250] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.234254] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.242624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.253989] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.254016] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.254026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.254031] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.254035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.262754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.273826] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.273854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.273869] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.273874] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.273878] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.282761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.294044] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.294074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.294083] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.294088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.294093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.302771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.314325] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.314353] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.314362] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.314367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.314372] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.322902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.334368] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.334396] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.334405] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.334410] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.334414] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.342944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.353919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.353947] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.353956] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.353961] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.353968] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.363069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.374298] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.374329] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.374338] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.374343] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.374347] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.382875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.455 [2024-04-26 15:13:20.394560] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.455 [2024-04-26 15:13:20.394587] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.455 [2024-04-26 15:13:20.394596] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.455 [2024-04-26 15:13:20.394601] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.455 [2024-04-26 15:13:20.394605] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.455 [2024-04-26 15:13:20.403108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.455 qpair failed and we were unable to recover it. 00:25:39.716 [2024-04-26 15:13:20.414922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.716 [2024-04-26 15:13:20.414956] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.716 [2024-04-26 15:13:20.414976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.716 [2024-04-26 15:13:20.414982] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.716 [2024-04-26 15:13:20.414986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.716 [2024-04-26 15:13:20.423292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.716 qpair failed and we were unable to recover it. 00:25:39.716 [2024-04-26 15:13:20.434409] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.716 [2024-04-26 15:13:20.434436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.716 [2024-04-26 15:13:20.434446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.716 [2024-04-26 15:13:20.434451] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.716 [2024-04-26 15:13:20.434456] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.716 [2024-04-26 15:13:20.443167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.716 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.454825] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.454858] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.454878] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.454884] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.454888] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.463307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.474855] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.474885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.474896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.474900] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.474905] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.483373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.494527] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.494553] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.494562] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.494567] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.494571] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.503313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.514319] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.514344] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.514354] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.514358] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.514363] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.523498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.534543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.534570] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.534582] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.534587] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.534591] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.543461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.555170] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.555200] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.555210] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.555215] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.555219] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.563740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.575239] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.575265] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.575275] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.575282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.575287] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.583726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.594723] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.594748] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.594757] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.594762] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.594767] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.603640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.615233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.615267] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.615280] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.615285] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.615289] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.623740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.635249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.635278] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.635288] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.635293] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.635297] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.643906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.717 [2024-04-26 15:13:20.655373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.717 [2024-04-26 15:13:20.655401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.717 [2024-04-26 15:13:20.655410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.717 [2024-04-26 15:13:20.655414] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.717 [2024-04-26 15:13:20.655419] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.717 [2024-04-26 15:13:20.663993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.717 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.675114] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.675138] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.675147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.675152] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.675156] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.683951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.695434] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.695463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.695472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.695477] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.695481] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.703975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.715555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.715585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.715596] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.715601] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.715605] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.724181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.735549] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.735577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.735587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.735592] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.735597] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.744422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.755148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.755176] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.755185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.755189] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.755194] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.764347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.775838] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.775871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.775880] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.775885] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.775889] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.784478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.795885] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.795910] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.795919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.795926] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.795933] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.804472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.815971] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.816003] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.816013] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.816017] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.816021] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.824464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.835653] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.835679] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.835688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.835693] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.835697] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.844607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.855844] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.855873] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.855882] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.855887] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.855891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.864465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.875850] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.875878] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.875887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.875892] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.875896] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.884785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.896103] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.896130] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.896139] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.896144] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.896148] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.904596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:39.979 [2024-04-26 15:13:20.915731] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:39.979 [2024-04-26 15:13:20.915758] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:39.979 [2024-04-26 15:13:20.915767] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:39.979 [2024-04-26 15:13:20.915772] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:39.979 [2024-04-26 15:13:20.915776] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:39.979 [2024-04-26 15:13:20.924735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:39.979 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:20.936119] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:20.936156] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:20.936165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:20.936170] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:20.936174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:20.944637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:20.956274] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:20.956309] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:20.956318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:20.956323] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:20.956328] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:20.964952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:20.976303] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:20.976335] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:20.976346] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:20.976351] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:20.976355] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:20.985105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:20.995999] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:20.996025] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:20.996034] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:20.996039] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:20.996044] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:21.005032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:21.016218] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:21.016247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:21.016256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:21.016261] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:21.016265] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:21.025028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:21.036442] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:21.036471] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:21.036480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:21.036486] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:21.036490] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:21.045096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.241 qpair failed and we were unable to recover it. 00:25:40.241 [2024-04-26 15:13:21.056315] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.241 [2024-04-26 15:13:21.056346] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.241 [2024-04-26 15:13:21.056355] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.241 [2024-04-26 15:13:21.056360] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.241 [2024-04-26 15:13:21.056364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.241 [2024-04-26 15:13:21.065165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.076294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.076319] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.076328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.076333] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.076337] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.085015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.096540] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.096568] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.096577] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.096582] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.096586] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.105003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.116617] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.116643] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.116652] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.116657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.116661] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.125297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.136857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.136885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.136894] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.136899] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.136903] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.145344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.156372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.156399] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.156411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.156415] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.156419] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.165443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.242 [2024-04-26 15:13:21.176732] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.242 [2024-04-26 15:13:21.176761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.242 [2024-04-26 15:13:21.176771] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.242 [2024-04-26 15:13:21.176775] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.242 [2024-04-26 15:13:21.176779] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.242 [2024-04-26 15:13:21.185608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.242 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.196833] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.196861] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.196871] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.196875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.196880] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.205472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.217055] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.217085] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.217095] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.217099] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.217104] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.225571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.236547] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.236573] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.236583] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.236587] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.236594] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.245614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.256907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.256942] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.256951] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.256956] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.256960] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.265830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.277080] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.277107] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.277117] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.277122] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.277126] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.285970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.297314] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.297343] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.297353] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.297358] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.297362] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.305957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.316684] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.316711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.504 [2024-04-26 15:13:21.316721] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.504 [2024-04-26 15:13:21.316726] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.504 [2024-04-26 15:13:21.316730] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.504 [2024-04-26 15:13:21.325798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.504 qpair failed and we were unable to recover it. 00:25:40.504 [2024-04-26 15:13:21.337316] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.504 [2024-04-26 15:13:21.337345] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.505 [2024-04-26 15:13:21.337355] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.505 [2024-04-26 15:13:21.337360] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.505 [2024-04-26 15:13:21.337364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.505 [2024-04-26 15:13:21.345884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.505 qpair failed and we were unable to recover it. 00:25:40.505 [2024-04-26 15:13:21.357252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.505 [2024-04-26 15:13:21.357283] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.505 [2024-04-26 15:13:21.357292] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.505 [2024-04-26 15:13:21.357297] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.505 [2024-04-26 15:13:21.357301] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.505 [2024-04-26 15:13:21.365901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.505 qpair failed and we were unable to recover it. 00:25:40.505 [2024-04-26 15:13:21.377499] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.505 [2024-04-26 15:13:21.377529] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.505 [2024-04-26 15:13:21.377538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.505 [2024-04-26 15:13:21.377542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.505 [2024-04-26 15:13:21.377546] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.505 [2024-04-26 15:13:21.386058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.505 qpair failed and we were unable to recover it. 00:25:40.505 [2024-04-26 15:13:21.396938] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:40.505 [2024-04-26 15:13:21.396964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:40.505 [2024-04-26 15:13:21.396973] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:40.505 [2024-04-26 15:13:21.396978] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:40.505 [2024-04-26 15:13:21.396982] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:25:40.505 [2024-04-26 15:13:21.406031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:40.505 qpair failed and we were unable to recover it. 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Write completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 Read completed with error (sct=0, sc=8) 00:25:41.889 starting I/O failed 00:25:41.889 [2024-04-26 15:13:22.411191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:25:41.889 [2024-04-26 15:13:22.420382] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:41.889 [2024-04-26 15:13:22.420418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:41.889 [2024-04-26 15:13:22.420436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:41.889 [2024-04-26 15:13:22.420444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:41.889 [2024-04-26 15:13:22.420451] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002b65c0 00:25:41.889 [2024-04-26 15:13:22.428933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:25:41.889 qpair failed and we were unable to recover it. 00:25:41.889 [2024-04-26 15:13:22.440449] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:41.889 [2024-04-26 15:13:22.440484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:41.889 [2024-04-26 15:13:22.440499] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:41.889 [2024-04-26 15:13:22.440506] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:41.889 [2024-04-26 15:13:22.440513] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002b65c0 00:25:41.889 [2024-04-26 15:13:22.449141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:25:41.889 qpair failed and we were unable to recover it. 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Read completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 Write completed with error (sct=0, sc=8) 00:25:42.839 starting I/O failed 00:25:42.839 [2024-04-26 15:13:23.454267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:42.839 [2024-04-26 15:13:23.463213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:42.839 [2024-04-26 15:13:23.463248] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:42.839 [2024-04-26 15:13:23.463268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:42.839 [2024-04-26 15:13:23.463280] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:42.839 [2024-04-26 15:13:23.463287] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:25:42.839 [2024-04-26 15:13:23.471893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:42.839 qpair failed and we were unable to recover it. 00:25:42.839 [2024-04-26 15:13:23.482933] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:25:42.839 [2024-04-26 15:13:23.482962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:25:42.839 [2024-04-26 15:13:23.482976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:25:42.839 [2024-04-26 15:13:23.482984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:25:42.839 [2024-04-26 15:13:23.482990] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:25:42.839 [2024-04-26 15:13:23.491927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:42.839 qpair failed and we were unable to recover it. 00:25:42.839 [2024-04-26 15:13:23.492094] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:25:42.839 A controller has encountered a failure and is being reset. 00:25:42.839 [2024-04-26 15:13:23.492218] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:25:42.839 [2024-04-26 15:13:23.494589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:42.839 Controller properly reset. 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Write completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 Read completed with error (sct=0, sc=8) 00:25:43.783 starting I/O failed 00:25:43.783 [2024-04-26 15:13:24.509906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:43.783 Initializing NVMe Controllers 00:25:43.783 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:43.783 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:25:43.783 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:25:43.783 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:25:43.783 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:25:43.783 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:25:43.783 Initialization complete. Launching workers. 00:25:43.783 Starting thread on core 1 00:25:43.783 Starting thread on core 2 00:25:43.783 Starting thread on core 3 00:25:43.783 Starting thread on core 0 00:25:43.783 15:13:24 -- host/target_disconnect.sh@59 -- # sync 00:25:43.783 00:25:43.783 real 0m14.555s 00:25:43.783 user 0m29.243s 00:25:43.783 sys 0m2.481s 00:25:43.783 15:13:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:25:43.783 15:13:24 -- common/autotest_common.sh@10 -- # set +x 00:25:43.783 ************************************ 00:25:43.783 END TEST nvmf_target_disconnect_tc2 00:25:43.783 ************************************ 00:25:43.783 15:13:24 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:25:43.783 15:13:24 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:25:43.783 15:13:24 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:25:43.783 15:13:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:25:43.783 15:13:24 -- common/autotest_common.sh@10 -- # set +x 00:25:44.045 ************************************ 00:25:44.045 START TEST nvmf_target_disconnect_tc3 00:25:44.045 ************************************ 00:25:44.045 15:13:24 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc3 00:25:44.045 15:13:24 -- host/target_disconnect.sh@65 -- # reconnectpid=3661777 00:25:44.045 15:13:24 -- host/target_disconnect.sh@67 -- # sleep 2 00:25:44.045 15:13:24 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:25:44.045 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.957 15:13:26 -- host/target_disconnect.sh@68 -- # kill -9 3659846 00:25:45.957 15:13:26 -- host/target_disconnect.sh@70 -- # sleep 2 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Read completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 Write completed with error (sct=0, sc=8) 00:25:47.342 starting I/O failed 00:25:47.342 [2024-04-26 15:13:27.963804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:47.342 [2024-04-26 15:13:27.966337] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:47.342 [2024-04-26 15:13:27.966353] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:47.342 [2024-04-26 15:13:27.966360] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:47.912 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 3659846 Killed "${NVMF_APP[@]}" "$@" 00:25:47.912 15:13:28 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:25:47.912 15:13:28 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:25:47.912 15:13:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:47.912 15:13:28 -- common/autotest_common.sh@720 -- # xtrace_disable 00:25:47.912 15:13:28 -- common/autotest_common.sh@10 -- # set +x 00:25:47.912 15:13:28 -- nvmf/common.sh@470 -- # nvmfpid=3662562 00:25:47.912 15:13:28 -- nvmf/common.sh@471 -- # waitforlisten 3662562 00:25:47.912 15:13:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:25:47.912 15:13:28 -- common/autotest_common.sh@827 -- # '[' -z 3662562 ']' 00:25:47.912 15:13:28 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:47.912 15:13:28 -- common/autotest_common.sh@832 -- # local max_retries=100 00:25:47.912 15:13:28 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:47.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:47.912 15:13:28 -- common/autotest_common.sh@836 -- # xtrace_disable 00:25:47.912 15:13:28 -- common/autotest_common.sh@10 -- # set +x 00:25:47.912 [2024-04-26 15:13:28.817247] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:25:47.912 [2024-04-26 15:13:28.817304] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:47.912 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.173 [2024-04-26 15:13:28.895580] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:48.173 [2024-04-26 15:13:28.948106] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:48.173 [2024-04-26 15:13:28.948139] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:48.173 [2024-04-26 15:13:28.948145] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:48.173 [2024-04-26 15:13:28.948149] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:48.173 [2024-04-26 15:13:28.948153] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:48.173 [2024-04-26 15:13:28.948340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:25:48.173 [2024-04-26 15:13:28.948591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:25:48.173 [2024-04-26 15:13:28.948742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:48.173 [2024-04-26 15:13:28.948743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:25:48.173 [2024-04-26 15:13:28.970643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:48.173 qpair failed and we were unable to recover it. 00:25:48.173 [2024-04-26 15:13:28.973168] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:48.173 [2024-04-26 15:13:28.973182] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:48.173 [2024-04-26 15:13:28.973189] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:48.744 15:13:29 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:25:48.744 15:13:29 -- common/autotest_common.sh@860 -- # return 0 00:25:48.744 15:13:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:25:48.744 15:13:29 -- common/autotest_common.sh@726 -- # xtrace_disable 00:25:48.744 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:48.744 15:13:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:48.744 15:13:29 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:48.744 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:48.744 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:48.744 Malloc0 00:25:48.744 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:48.744 15:13:29 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:25:48.744 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:48.744 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:48.744 [2024-04-26 15:13:29.684767] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xe2adc0/0xe36a40) succeed. 00:25:49.005 [2024-04-26 15:13:29.696110] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xe2c400/0xed6b40) succeed. 00:25:49.005 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:49.005 15:13:29 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:49.005 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:49.005 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:49.005 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:49.005 15:13:29 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:49.005 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:49.005 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:49.005 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:49.005 15:13:29 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:25:49.005 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:49.005 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:49.005 [2024-04-26 15:13:29.814624] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:25:49.005 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:49.005 15:13:29 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:25:49.005 15:13:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:25:49.005 15:13:29 -- common/autotest_common.sh@10 -- # set +x 00:25:49.005 15:13:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:25:49.005 15:13:29 -- host/target_disconnect.sh@73 -- # wait 3661777 00:25:49.266 [2024-04-26 15:13:29.977275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:49.266 qpair failed and we were unable to recover it. 00:25:49.266 [2024-04-26 15:13:29.979614] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:49.266 [2024-04-26 15:13:29.979628] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:49.266 [2024-04-26 15:13:29.979634] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:50.207 [2024-04-26 15:13:30.983913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:50.207 qpair failed and we were unable to recover it. 00:25:50.207 [2024-04-26 15:13:30.986372] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:50.207 [2024-04-26 15:13:30.986388] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:50.207 [2024-04-26 15:13:30.986395] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:51.148 [2024-04-26 15:13:31.990515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:51.148 qpair failed and we were unable to recover it. 00:25:51.148 [2024-04-26 15:13:31.992632] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:51.148 [2024-04-26 15:13:31.992646] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:51.148 [2024-04-26 15:13:31.992652] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:52.089 [2024-04-26 15:13:32.996808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:52.089 qpair failed and we were unable to recover it. 00:25:52.089 [2024-04-26 15:13:32.999115] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:52.089 [2024-04-26 15:13:32.999129] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:52.089 [2024-04-26 15:13:32.999135] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:53.476 [2024-04-26 15:13:34.003305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:53.476 qpair failed and we were unable to recover it. 00:25:53.476 [2024-04-26 15:13:34.005502] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:53.476 [2024-04-26 15:13:34.005516] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:53.476 [2024-04-26 15:13:34.005522] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:54.418 [2024-04-26 15:13:35.009653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:54.418 qpair failed and we were unable to recover it. 00:25:54.418 [2024-04-26 15:13:35.012139] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:54.418 [2024-04-26 15:13:35.012153] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:54.418 [2024-04-26 15:13:35.012163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:25:55.360 [2024-04-26 15:13:36.016227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:25:55.360 qpair failed and we were unable to recover it. 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Read completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 Write completed with error (sct=0, sc=8) 00:25:56.302 starting I/O failed 00:25:56.302 [2024-04-26 15:13:37.021248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Write completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.245 Read completed with error (sct=0, sc=8) 00:25:57.245 starting I/O failed 00:25:57.246 Write completed with error (sct=0, sc=8) 00:25:57.246 starting I/O failed 00:25:57.246 [2024-04-26 15:13:38.026126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:57.246 [2024-04-26 15:13:38.028232] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:57.246 [2024-04-26 15:13:38.028250] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:57.246 [2024-04-26 15:13:38.028256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:25:58.188 [2024-04-26 15:13:39.032108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:58.188 qpair failed and we were unable to recover it. 00:25:58.188 [2024-04-26 15:13:39.034001] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:58.189 [2024-04-26 15:13:39.034015] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:58.189 [2024-04-26 15:13:39.034022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:25:59.132 [2024-04-26 15:13:40.037962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:25:59.132 qpair failed and we were unable to recover it. 00:25:59.132 [2024-04-26 15:13:40.040685] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:25:59.132 [2024-04-26 15:13:40.040707] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:25:59.132 [2024-04-26 15:13:40.040713] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:26:00.517 [2024-04-26 15:13:41.044968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:00.517 qpair failed and we were unable to recover it. 00:26:00.517 [2024-04-26 15:13:41.047056] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:00.517 [2024-04-26 15:13:41.047067] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:00.517 [2024-04-26 15:13:41.047072] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:26:01.461 [2024-04-26 15:13:42.051322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:26:01.461 qpair failed and we were unable to recover it. 00:26:01.461 [2024-04-26 15:13:42.051451] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:26:01.461 A controller has encountered a failure and is being reset. 00:26:01.461 Resorting to new failover address 192.168.100.9 00:26:01.461 [2024-04-26 15:13:42.051548] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:01.461 [2024-04-26 15:13:42.051604] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:01.461 [2024-04-26 15:13:42.053772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:01.461 Controller properly reset. 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Write completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.403 starting I/O failed 00:26:02.403 Read completed with error (sct=0, sc=8) 00:26:02.404 starting I/O failed 00:26:02.404 Write completed with error (sct=0, sc=8) 00:26:02.404 starting I/O failed 00:26:02.404 Read completed with error (sct=0, sc=8) 00:26:02.404 starting I/O failed 00:26:02.404 Read completed with error (sct=0, sc=8) 00:26:02.404 starting I/O failed 00:26:02.404 [2024-04-26 15:13:43.109726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:26:02.404 Initializing NVMe Controllers 00:26:02.404 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.404 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:26:02.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:26:02.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:26:02.404 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:26:02.404 Initialization complete. Launching workers. 00:26:02.404 Starting thread on core 1 00:26:02.404 Starting thread on core 2 00:26:02.404 Starting thread on core 3 00:26:02.404 Starting thread on core 0 00:26:02.404 15:13:43 -- host/target_disconnect.sh@74 -- # sync 00:26:02.404 00:26:02.404 real 0m18.421s 00:26:02.404 user 1m8.600s 00:26:02.404 sys 0m3.875s 00:26:02.404 15:13:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:26:02.404 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:02.404 ************************************ 00:26:02.404 END TEST nvmf_target_disconnect_tc3 00:26:02.404 ************************************ 00:26:02.404 15:13:43 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:26:02.404 15:13:43 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:26:02.404 15:13:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:02.404 15:13:43 -- nvmf/common.sh@117 -- # sync 00:26:02.404 15:13:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:02.404 15:13:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:02.404 15:13:43 -- nvmf/common.sh@120 -- # set +e 00:26:02.404 15:13:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:02.404 15:13:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:02.404 rmmod nvme_rdma 00:26:02.404 rmmod nvme_fabrics 00:26:02.404 15:13:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:02.404 15:13:43 -- nvmf/common.sh@124 -- # set -e 00:26:02.404 15:13:43 -- nvmf/common.sh@125 -- # return 0 00:26:02.404 15:13:43 -- nvmf/common.sh@478 -- # '[' -n 3662562 ']' 00:26:02.404 15:13:43 -- nvmf/common.sh@479 -- # killprocess 3662562 00:26:02.404 15:13:43 -- common/autotest_common.sh@946 -- # '[' -z 3662562 ']' 00:26:02.404 15:13:43 -- common/autotest_common.sh@950 -- # kill -0 3662562 00:26:02.404 15:13:43 -- common/autotest_common.sh@951 -- # uname 00:26:02.404 15:13:43 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:26:02.404 15:13:43 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3662562 00:26:02.404 15:13:43 -- common/autotest_common.sh@952 -- # process_name=reactor_4 00:26:02.404 15:13:43 -- common/autotest_common.sh@956 -- # '[' reactor_4 = sudo ']' 00:26:02.404 15:13:43 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3662562' 00:26:02.404 killing process with pid 3662562 00:26:02.404 15:13:43 -- common/autotest_common.sh@965 -- # kill 3662562 00:26:02.404 15:13:43 -- common/autotest_common.sh@970 -- # wait 3662562 00:26:02.664 [2024-04-26 15:13:43.400186] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:02.664 15:13:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:02.664 15:13:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:02.664 00:26:02.664 real 0m41.625s 00:26:02.664 user 2m38.831s 00:26:02.664 sys 0m11.887s 00:26:02.664 15:13:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:26:02.664 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:02.664 ************************************ 00:26:02.664 END TEST nvmf_target_disconnect 00:26:02.664 ************************************ 00:26:02.664 15:13:43 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:26:02.664 15:13:43 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:02.664 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:02.664 15:13:43 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:26:02.664 00:26:02.664 real 19m35.684s 00:26:02.664 user 54m53.121s 00:26:02.664 sys 4m44.266s 00:26:02.664 15:13:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:26:02.664 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:02.664 ************************************ 00:26:02.664 END TEST nvmf_rdma 00:26:02.664 ************************************ 00:26:02.925 15:13:43 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:26:02.925 15:13:43 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:26:02.925 15:13:43 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:26:02.925 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:02.925 ************************************ 00:26:02.925 START TEST spdkcli_nvmf_rdma 00:26:02.925 ************************************ 00:26:02.925 15:13:43 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:26:03.187 * Looking for test storage... 00:26:03.187 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:26:03.187 15:13:43 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:26:03.187 15:13:43 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.187 15:13:43 -- nvmf/common.sh@7 -- # uname -s 00:26:03.187 15:13:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.187 15:13:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.187 15:13:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.187 15:13:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.187 15:13:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.187 15:13:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.187 15:13:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.187 15:13:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.187 15:13:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.187 15:13:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.187 15:13:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:03.187 15:13:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00d0226a-fbea-ec11-9bc7-a4bf019282be 00:26:03.187 15:13:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.187 15:13:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.187 15:13:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.187 15:13:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:03.187 15:13:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:03.187 15:13:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.187 15:13:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.187 15:13:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.187 15:13:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.187 15:13:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.187 15:13:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.187 15:13:43 -- paths/export.sh@5 -- # export PATH 00:26:03.187 15:13:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.187 15:13:43 -- nvmf/common.sh@47 -- # : 0 00:26:03.187 15:13:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:03.187 15:13:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:03.187 15:13:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:03.187 15:13:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.187 15:13:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.187 15:13:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:03.187 15:13:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:03.187 15:13:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:26:03.187 15:13:43 -- common/autotest_common.sh@720 -- # xtrace_disable 00:26:03.187 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:03.187 15:13:43 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:26:03.187 15:13:43 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3665541 00:26:03.187 15:13:43 -- spdkcli/common.sh@34 -- # waitforlisten 3665541 00:26:03.187 15:13:43 -- common/autotest_common.sh@827 -- # '[' -z 3665541 ']' 00:26:03.187 15:13:43 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.187 15:13:43 -- common/autotest_common.sh@832 -- # local max_retries=100 00:26:03.187 15:13:43 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:26:03.187 15:13:43 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.187 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.187 15:13:43 -- common/autotest_common.sh@836 -- # xtrace_disable 00:26:03.187 15:13:43 -- common/autotest_common.sh@10 -- # set +x 00:26:03.187 [2024-04-26 15:13:43.979733] Starting SPDK v24.05-pre git sha1 52d0b12f9 / DPDK 23.11.0 initialization... 00:26:03.187 [2024-04-26 15:13:43.979786] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3665541 ] 00:26:03.187 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.187 [2024-04-26 15:13:44.037913] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:26:03.187 [2024-04-26 15:13:44.101333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:03.187 [2024-04-26 15:13:44.101366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:04.131 15:13:44 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:26:04.131 15:13:44 -- common/autotest_common.sh@860 -- # return 0 00:26:04.131 15:13:44 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:26:04.131 15:13:44 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:04.131 15:13:44 -- common/autotest_common.sh@10 -- # set +x 00:26:04.131 15:13:44 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:26:04.131 15:13:44 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:26:04.131 15:13:44 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:26:04.131 15:13:44 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:04.131 15:13:44 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:04.131 15:13:44 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:04.131 15:13:44 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:04.131 15:13:44 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:04.131 15:13:44 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.131 15:13:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:26:04.131 15:13:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:04.131 15:13:44 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:04.131 15:13:44 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:04.131 15:13:44 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:04.131 15:13:44 -- common/autotest_common.sh@10 -- # set +x 00:26:10.722 15:13:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:10.722 15:13:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:10.722 15:13:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:10.722 15:13:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:10.722 15:13:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:10.722 15:13:51 -- nvmf/common.sh@295 -- # net_devs=() 00:26:10.722 15:13:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@296 -- # e810=() 00:26:10.722 15:13:51 -- nvmf/common.sh@296 -- # local -ga e810 00:26:10.722 15:13:51 -- nvmf/common.sh@297 -- # x722=() 00:26:10.722 15:13:51 -- nvmf/common.sh@297 -- # local -ga x722 00:26:10.722 15:13:51 -- nvmf/common.sh@298 -- # mlx=() 00:26:10.722 15:13:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:10.722 15:13:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:10.722 15:13:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.0 (0x15b3 - 0x1017)' 00:26:10.722 Found 0000:31:00.0 (0x15b3 - 0x1017) 00:26:10.722 15:13:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:10.722 15:13:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:31:00.1 (0x15b3 - 0x1017)' 00:26:10.722 Found 0000:31:00.1 (0x15b3 - 0x1017) 00:26:10.722 15:13:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@350 -- # [[ 0x1017 == \0\x\1\0\1\7 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:10.722 15:13:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:10.722 15:13:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:10.722 15:13:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.0: mlx_0_0' 00:26:10.722 Found net devices under 0000:31:00.0: mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:10.722 15:13:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:10.722 15:13:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:31:00.1: mlx_0_1' 00:26:10.722 Found net devices under 0000:31:00.1: mlx_0_1 00:26:10.722 15:13:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:10.722 15:13:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:10.722 15:13:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:10.722 15:13:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:10.722 15:13:51 -- nvmf/common.sh@58 -- # uname 00:26:10.722 15:13:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:10.722 15:13:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:10.722 15:13:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:10.722 15:13:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:10.722 15:13:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:10.722 15:13:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:10.722 15:13:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:10.722 15:13:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:10.722 15:13:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:10.722 15:13:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:10.722 15:13:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:10.722 15:13:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:10.722 15:13:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:10.722 15:13:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@105 -- # continue 2 00:26:10.722 15:13:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:10.722 15:13:51 -- nvmf/common.sh@105 -- # continue 2 00:26:10.722 15:13:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:10.722 15:13:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:10.722 15:13:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:10.722 15:13:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:10.722 266: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:10.722 link/ether 0c:42:a1:73:4d:ae brd ff:ff:ff:ff:ff:ff 00:26:10.722 altname enp49s0f0np0 00:26:10.722 altname ens786f0np0 00:26:10.722 inet 192.168.100.8/24 scope global mlx_0_0 00:26:10.722 valid_lft forever preferred_lft forever 00:26:10.722 15:13:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:10.722 15:13:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:10.722 15:13:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:10.722 15:13:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:10.722 15:13:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:10.722 15:13:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:10.722 267: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:10.722 link/ether 0c:42:a1:73:4d:af brd ff:ff:ff:ff:ff:ff 00:26:10.722 altname enp49s0f1np1 00:26:10.722 altname ens786f1np1 00:26:10.722 inet 192.168.100.9/24 scope global mlx_0_1 00:26:10.722 valid_lft forever preferred_lft forever 00:26:10.722 15:13:51 -- nvmf/common.sh@411 -- # return 0 00:26:10.722 15:13:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:10.722 15:13:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:10.722 15:13:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:10.722 15:13:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:10.722 15:13:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:10.722 15:13:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:10.722 15:13:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:10.722 15:13:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:10.722 15:13:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.722 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:10.722 15:13:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:10.722 15:13:51 -- nvmf/common.sh@105 -- # continue 2 00:26:10.722 15:13:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:10.723 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.723 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:10.723 15:13:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:10.723 15:13:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:10.723 15:13:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:10.723 15:13:51 -- nvmf/common.sh@105 -- # continue 2 00:26:10.723 15:13:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:10.723 15:13:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:10.723 15:13:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:10.723 15:13:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:10.723 15:13:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:10.723 15:13:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:10.723 15:13:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:10.723 15:13:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:10.723 192.168.100.9' 00:26:10.723 15:13:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:10.723 192.168.100.9' 00:26:10.723 15:13:51 -- nvmf/common.sh@446 -- # head -n 1 00:26:10.723 15:13:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:10.723 15:13:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:10.723 192.168.100.9' 00:26:10.723 15:13:51 -- nvmf/common.sh@447 -- # tail -n +2 00:26:10.723 15:13:51 -- nvmf/common.sh@447 -- # head -n 1 00:26:10.723 15:13:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:10.723 15:13:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:10.723 15:13:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:10.723 15:13:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:10.723 15:13:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:10.723 15:13:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:10.723 15:13:51 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:26:10.723 15:13:51 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:26:10.723 15:13:51 -- common/autotest_common.sh@720 -- # xtrace_disable 00:26:10.723 15:13:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.723 15:13:51 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:26:10.723 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:26:10.723 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:26:10.723 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:26:10.723 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:26:10.723 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:26:10.723 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:26:10.723 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:26:10.723 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:26:10.723 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:26:10.723 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:26:10.723 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:26:10.723 ' 00:26:10.983 [2024-04-26 15:13:51.833473] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:13.531 [2024-04-26 15:13:53.861619] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1901630/0x19135b0) succeed. 00:26:13.531 [2024-04-26 15:13:53.876980] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1902b80/0x1954c40) succeed. 00:26:14.506 [2024-04-26 15:13:55.101553] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:26:16.453 [2024-04-26 15:13:57.240008] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:26:18.365 [2024-04-26 15:13:59.073803] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:26:19.753 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:26:19.753 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:26:19.753 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:26:19.753 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:26:19.753 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:26:19.753 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:26:19.753 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:26:19.753 15:14:00 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:26:19.753 15:14:00 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:19.753 15:14:00 -- common/autotest_common.sh@10 -- # set +x 00:26:19.753 15:14:00 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:26:19.753 15:14:00 -- common/autotest_common.sh@720 -- # xtrace_disable 00:26:19.753 15:14:00 -- common/autotest_common.sh@10 -- # set +x 00:26:19.753 15:14:00 -- spdkcli/nvmf.sh@69 -- # check_match 00:26:19.753 15:14:00 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:26:20.325 15:14:00 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:26:20.325 15:14:01 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:26:20.325 15:14:01 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:26:20.325 15:14:01 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:20.325 15:14:01 -- common/autotest_common.sh@10 -- # set +x 00:26:20.325 15:14:01 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:26:20.325 15:14:01 -- common/autotest_common.sh@720 -- # xtrace_disable 00:26:20.325 15:14:01 -- common/autotest_common.sh@10 -- # set +x 00:26:20.325 15:14:01 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:26:20.325 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:26:20.325 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:26:20.325 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:26:20.325 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:26:20.325 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:26:20.325 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:26:20.325 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:26:20.325 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:26:20.325 ' 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:26:25.640 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:26:25.640 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:26:25.640 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:26:25.640 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:26:25.640 15:14:06 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:26:25.640 15:14:06 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:25.640 15:14:06 -- common/autotest_common.sh@10 -- # set +x 00:26:25.640 15:14:06 -- spdkcli/nvmf.sh@90 -- # killprocess 3665541 00:26:25.640 15:14:06 -- common/autotest_common.sh@946 -- # '[' -z 3665541 ']' 00:26:25.640 15:14:06 -- common/autotest_common.sh@950 -- # kill -0 3665541 00:26:25.640 15:14:06 -- common/autotest_common.sh@951 -- # uname 00:26:25.640 15:14:06 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:26:25.640 15:14:06 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 3665541 00:26:25.640 15:14:06 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:26:25.640 15:14:06 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:26:25.640 15:14:06 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 3665541' 00:26:25.640 killing process with pid 3665541 00:26:25.640 15:14:06 -- common/autotest_common.sh@965 -- # kill 3665541 00:26:25.640 [2024-04-26 15:14:06.116292] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:25.640 15:14:06 -- common/autotest_common.sh@970 -- # wait 3665541 00:26:25.640 [2024-04-26 15:14:06.174205] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:25.640 15:14:06 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:26:25.640 15:14:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:25.640 15:14:06 -- nvmf/common.sh@117 -- # sync 00:26:25.640 15:14:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:25.640 15:14:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:25.640 15:14:06 -- nvmf/common.sh@120 -- # set +e 00:26:25.640 15:14:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:25.640 15:14:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:25.640 rmmod nvme_rdma 00:26:25.640 rmmod nvme_fabrics 00:26:25.640 15:14:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:25.640 15:14:06 -- nvmf/common.sh@124 -- # set -e 00:26:25.640 15:14:06 -- nvmf/common.sh@125 -- # return 0 00:26:25.640 15:14:06 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:26:25.640 15:14:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:25.640 15:14:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:25.640 00:26:25.640 real 0m22.576s 00:26:25.640 user 0m48.040s 00:26:25.640 sys 0m5.523s 00:26:25.640 15:14:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:26:25.640 15:14:06 -- common/autotest_common.sh@10 -- # set +x 00:26:25.640 ************************************ 00:26:25.640 END TEST spdkcli_nvmf_rdma 00:26:25.640 ************************************ 00:26:25.640 15:14:06 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:26:25.640 15:14:06 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:26:25.640 15:14:06 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:26:25.640 15:14:06 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:26:25.640 15:14:06 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:26:25.640 15:14:06 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:26:25.640 15:14:06 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:26:25.640 15:14:06 -- common/autotest_common.sh@720 -- # xtrace_disable 00:26:25.640 15:14:06 -- common/autotest_common.sh@10 -- # set +x 00:26:25.640 15:14:06 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:26:25.640 15:14:06 -- common/autotest_common.sh@1388 -- # local autotest_es=0 00:26:25.640 15:14:06 -- common/autotest_common.sh@1389 -- # xtrace_disable 00:26:25.640 15:14:06 -- common/autotest_common.sh@10 -- # set +x 00:26:33.792 INFO: APP EXITING 00:26:33.792 INFO: killing all VMs 00:26:33.792 INFO: killing vhost app 00:26:33.792 WARN: no vhost pid file found 00:26:33.792 INFO: EXIT DONE 00:26:35.711 Waiting for block devices as requested 00:26:35.711 0000:80:01.6 (8086 0b00): vfio-pci -> ioatdma 00:26:35.711 0000:80:01.7 (8086 0b00): vfio-pci -> ioatdma 00:26:35.711 0000:80:01.4 (8086 0b00): vfio-pci -> ioatdma 00:26:35.972 0000:80:01.5 (8086 0b00): vfio-pci -> ioatdma 00:26:35.972 0000:80:01.2 (8086 0b00): vfio-pci -> ioatdma 00:26:35.972 0000:80:01.3 (8086 0b00): vfio-pci -> ioatdma 00:26:36.233 0000:80:01.0 (8086 0b00): vfio-pci -> ioatdma 00:26:36.233 0000:80:01.1 (8086 0b00): vfio-pci -> ioatdma 00:26:36.233 0000:65:00.0 (144d a80a): vfio-pci -> nvme 00:26:36.494 0000:00:01.6 (8086 0b00): vfio-pci -> ioatdma 00:26:36.494 0000:00:01.7 (8086 0b00): vfio-pci -> ioatdma 00:26:36.494 0000:00:01.4 (8086 0b00): vfio-pci -> ioatdma 00:26:36.494 0000:00:01.5 (8086 0b00): vfio-pci -> ioatdma 00:26:36.755 0000:00:01.2 (8086 0b00): vfio-pci -> ioatdma 00:26:36.755 0000:00:01.3 (8086 0b00): vfio-pci -> ioatdma 00:26:36.755 0000:00:01.0 (8086 0b00): vfio-pci -> ioatdma 00:26:37.017 0000:00:01.1 (8086 0b00): vfio-pci -> ioatdma 00:26:40.326 Cleaning 00:26:40.326 Removing: /var/run/dpdk/spdk0/config 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:26:40.326 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:26:40.326 Removing: /var/run/dpdk/spdk0/hugepage_info 00:26:40.326 Removing: /var/run/dpdk/spdk1/config 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:26:40.326 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:26:40.326 Removing: /var/run/dpdk/spdk1/hugepage_info 00:26:40.326 Removing: /var/run/dpdk/spdk1/mp_socket 00:26:40.326 Removing: /var/run/dpdk/spdk2/config 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:26:40.326 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:26:40.326 Removing: /var/run/dpdk/spdk2/hugepage_info 00:26:40.326 Removing: /var/run/dpdk/spdk3/config 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:26:40.326 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:26:40.587 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:26:40.587 Removing: /var/run/dpdk/spdk3/hugepage_info 00:26:40.587 Removing: /var/run/dpdk/spdk4/config 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:26:40.587 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:26:40.587 Removing: /var/run/dpdk/spdk4/hugepage_info 00:26:40.587 Removing: /dev/shm/bdevperf_trace.pid3454248 00:26:40.587 Removing: /dev/shm/bdevperf_trace.pid3578617 00:26:40.587 Removing: /dev/shm/bdev_svc_trace.1 00:26:40.587 Removing: /dev/shm/nvmf_trace.0 00:26:40.587 Removing: /dev/shm/spdk_tgt_trace.pid3304316 00:26:40.587 Removing: /var/run/dpdk/spdk0 00:26:40.587 Removing: /var/run/dpdk/spdk1 00:26:40.587 Removing: /var/run/dpdk/spdk2 00:26:40.587 Removing: /var/run/dpdk/spdk3 00:26:40.587 Removing: /var/run/dpdk/spdk4 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3302599 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3304316 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3305111 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3306360 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3306508 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3307783 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3307820 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3308254 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3312973 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3313522 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3313861 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3314239 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3314650 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3315057 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3315421 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3315781 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3316150 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3317575 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3320856 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3321231 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3321597 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3321828 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3322309 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3322373 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3322908 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3323031 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3323407 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3323496 00:26:40.587 Removing: /var/run/dpdk/spdk_pid3323784 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3323979 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3324566 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3324925 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3325229 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3325538 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3325745 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3325837 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3326190 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3326551 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3326916 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3327277 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3327609 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3327861 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3328105 00:26:40.849 Removing: /var/run/dpdk/spdk_pid3328401 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3328755 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3329111 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3329473 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3329829 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3330136 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3330373 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3330620 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3330949 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3331315 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3331697 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3332140 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3332501 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3332579 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3332998 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3337984 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3408124 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3412805 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3423285 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3429323 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3433430 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3434353 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3454248 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3454602 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3459314 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3465879 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3468859 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3480286 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3513330 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3517623 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3536011 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3576473 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3577345 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3578617 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3583875 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3591925 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3592947 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3594018 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3595181 00:26:40.850 Removing: /var/run/dpdk/spdk_pid3595609 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3600625 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3600627 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3605333 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3605994 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3606673 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3607357 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3607525 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3612718 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3613469 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3618377 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3621437 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3629436 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3629446 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3651503 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3651763 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3658559 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3659161 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3661777 00:26:41.112 Removing: /var/run/dpdk/spdk_pid3665541 00:26:41.112 Clean 00:26:41.374 15:14:22 -- common/autotest_common.sh@1447 -- # return 0 00:26:41.374 15:14:22 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:26:41.374 15:14:22 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:41.374 15:14:22 -- common/autotest_common.sh@10 -- # set +x 00:26:41.374 15:14:22 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:26:41.374 15:14:22 -- common/autotest_common.sh@726 -- # xtrace_disable 00:26:41.374 15:14:22 -- common/autotest_common.sh@10 -- # set +x 00:26:41.374 15:14:22 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:26:41.374 15:14:22 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:26:41.374 15:14:22 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:26:41.374 15:14:22 -- spdk/autotest.sh@389 -- # hash lcov 00:26:41.374 15:14:22 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:26:41.374 15:14:22 -- spdk/autotest.sh@391 -- # hostname 00:26:41.374 15:14:22 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-cyp-09 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:26:41.635 geninfo: WARNING: invalid characters removed from testname! 00:27:03.602 15:14:43 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:05.516 15:14:46 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:06.900 15:14:47 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:08.815 15:14:49 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:10.200 15:14:51 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:12.161 15:14:52 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:27:13.554 15:14:54 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:27:13.554 15:14:54 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:13.554 15:14:54 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:27:13.554 15:14:54 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:13.554 15:14:54 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:13.554 15:14:54 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.554 15:14:54 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.554 15:14:54 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.554 15:14:54 -- paths/export.sh@5 -- $ export PATH 00:27:13.554 15:14:54 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:13.554 15:14:54 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:27:13.554 15:14:54 -- common/autobuild_common.sh@435 -- $ date +%s 00:27:13.554 15:14:54 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714137294.XXXXXX 00:27:13.554 15:14:54 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714137294.9Cn7pT 00:27:13.554 15:14:54 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:27:13.554 15:14:54 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:27:13.554 15:14:54 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:27:13.554 15:14:54 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:27:13.554 15:14:54 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:27:13.554 15:14:54 -- common/autobuild_common.sh@451 -- $ get_config_params 00:27:13.554 15:14:54 -- common/autotest_common.sh@395 -- $ xtrace_disable 00:27:13.554 15:14:54 -- common/autotest_common.sh@10 -- $ set +x 00:27:13.555 15:14:54 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:27:13.555 15:14:54 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:27:13.555 15:14:54 -- pm/common@17 -- $ local monitor 00:27:13.555 15:14:54 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:13.555 15:14:54 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3682930 00:27:13.555 15:14:54 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:13.555 15:14:54 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3682931 00:27:13.555 15:14:54 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:13.555 15:14:54 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3682932 00:27:13.555 15:14:54 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:13.555 15:14:54 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3682934 00:27:13.555 15:14:54 -- pm/common@26 -- $ sleep 1 00:27:13.555 15:14:54 -- pm/common@21 -- $ date +%s 00:27:13.555 15:14:54 -- pm/common@21 -- $ date +%s 00:27:13.555 15:14:54 -- pm/common@21 -- $ date +%s 00:27:13.555 15:14:54 -- pm/common@21 -- $ date +%s 00:27:13.555 15:14:54 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714137294 00:27:13.555 15:14:54 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714137294 00:27:13.555 15:14:54 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714137294 00:27:13.555 15:14:54 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714137294 00:27:13.555 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714137294_collect-bmc-pm.bmc.pm.log 00:27:13.555 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714137294_collect-cpu-load.pm.log 00:27:13.555 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714137294_collect-vmstat.pm.log 00:27:13.555 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714137294_collect-cpu-temp.pm.log 00:27:14.497 15:14:55 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:27:14.497 15:14:55 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j144 00:27:14.497 15:14:55 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:27:14.497 15:14:55 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:27:14.497 15:14:55 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:27:14.497 15:14:55 -- spdk/autopackage.sh@19 -- $ timing_finish 00:27:14.497 15:14:55 -- common/autotest_common.sh@732 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:27:14.497 15:14:55 -- common/autotest_common.sh@733 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:27:14.497 15:14:55 -- common/autotest_common.sh@735 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:27:14.497 15:14:55 -- spdk/autopackage.sh@20 -- $ exit 0 00:27:14.497 15:14:55 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:27:14.497 15:14:55 -- pm/common@30 -- $ signal_monitor_resources TERM 00:27:14.497 15:14:55 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:27:14.497 15:14:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:14.497 15:14:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:27:14.497 15:14:55 -- pm/common@45 -- $ pid=3682948 00:27:14.497 15:14:55 -- pm/common@52 -- $ sudo kill -TERM 3682948 00:27:14.497 15:14:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:14.497 15:14:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:27:14.497 15:14:55 -- pm/common@45 -- $ pid=3682951 00:27:14.497 15:14:55 -- pm/common@52 -- $ sudo kill -TERM 3682951 00:27:14.497 15:14:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:14.497 15:14:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:27:14.497 15:14:55 -- pm/common@45 -- $ pid=3682950 00:27:14.497 15:14:55 -- pm/common@52 -- $ sudo kill -TERM 3682950 00:27:14.497 15:14:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:27:14.497 15:14:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:27:14.497 15:14:55 -- pm/common@45 -- $ pid=3682949 00:27:14.497 15:14:55 -- pm/common@52 -- $ sudo kill -TERM 3682949 00:27:14.497 + [[ -n 3186027 ]] 00:27:14.497 + sudo kill 3186027 00:27:14.508 [Pipeline] } 00:27:14.525 [Pipeline] // stage 00:27:14.530 [Pipeline] } 00:27:14.550 [Pipeline] // timeout 00:27:14.555 [Pipeline] } 00:27:14.571 [Pipeline] // catchError 00:27:14.576 [Pipeline] } 00:27:14.593 [Pipeline] // wrap 00:27:14.599 [Pipeline] } 00:27:14.612 [Pipeline] // catchError 00:27:14.621 [Pipeline] stage 00:27:14.624 [Pipeline] { (Epilogue) 00:27:14.638 [Pipeline] catchError 00:27:14.640 [Pipeline] { 00:27:14.652 [Pipeline] echo 00:27:14.653 Cleanup processes 00:27:14.659 [Pipeline] sh 00:27:14.947 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:27:14.947 3683056 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:27:14.947 3683496 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:27:14.960 [Pipeline] sh 00:27:15.248 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:27:15.248 ++ grep -v 'sudo pgrep' 00:27:15.248 ++ awk '{print $1}' 00:27:15.248 + sudo kill -9 3683056 00:27:15.281 [Pipeline] sh 00:27:15.570 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:27:25.587 [Pipeline] sh 00:27:25.874 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:27:25.874 Artifacts sizes are good 00:27:25.889 [Pipeline] archiveArtifacts 00:27:25.896 Archiving artifacts 00:27:26.048 [Pipeline] sh 00:27:26.334 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:27:26.349 [Pipeline] cleanWs 00:27:26.360 [WS-CLEANUP] Deleting project workspace... 00:27:26.360 [WS-CLEANUP] Deferred wipeout is used... 00:27:26.367 [WS-CLEANUP] done 00:27:26.369 [Pipeline] } 00:27:26.387 [Pipeline] // catchError 00:27:26.398 [Pipeline] sh 00:27:26.685 + logger -p user.info -t JENKINS-CI 00:27:26.696 [Pipeline] } 00:27:26.736 [Pipeline] // stage 00:27:26.742 [Pipeline] } 00:27:26.758 [Pipeline] // node 00:27:26.764 [Pipeline] End of Pipeline 00:27:26.796 Finished: SUCCESS